-- Logs begin at Tue 2021-07-27 14:44:49 UTC, end at Tue 2021-07-27 15:39:50 UTC. -- Jul 27 15:13:21.980076 dv-cinder-800431-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 15:13:21.987321 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 15:13:21.989304 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 27 15:13:21 2021] *** Jul 27 15:13:21.989304 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 15:13:21.989304 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 15:13:21.989304 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: nodename: dv-cinder-800431-2-iscsi Jul 27 15:13:21.989304 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: machine: x86_64 Jul 27 15:13:21.989304 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: clock source: unix Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: pcre jit disabled Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: detected number of CPU cores: 4 Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: current working directory: / Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: detected binary path: /usr/bin/uwsgi-core Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: your processes number limit is 47680 Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: your memory page size is 4096 bytes Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: detected max file descriptor number: 2048 Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: lock engine: pthread robust mutexes Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: thunder lock: enabled Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 15:13:21.989736 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 27 15:13:22.034340 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: Python main interpreter initialized at 0x55ba60b759c0 Jul 27 15:13:22.034340 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: python threads support enabled Jul 27 15:13:22.034340 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: your server socket listen backlog is limited to 100 connections Jul 27 15:13:22.034340 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: your mercy for graceful operations on workers is 90 seconds Jul 27 15:13:22.034715 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 15:13:22.034836 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: *** Operational MODE: preforking *** Jul 27 15:13:22.035101 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: *** uWSGI is running in multiple interpreter mode *** Jul 27 15:13:22.035101 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: spawned uWSGI master process (pid: 92347) Jul 27 15:13:22.035285 dv-cinder-800431-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 15:13:22.036678 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: spawned uWSGI worker 1 (pid: 92348, cores: 1) Jul 27 15:13:22.036678 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: spawned uWSGI worker 2 (pid: 92349, cores: 1) Jul 27 15:13:22.036678 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 15:13:23.669125 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:13:23.669125 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: from cryptography.utils import int_from_bytes Jul 27 15:13:23.669803 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:13:23.669803 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: from cryptography.utils import int_from_bytes Jul 27 15:13:23.679225 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:13:23.679225 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: from cryptography.utils import int_from_bytes Jul 27 15:13:23.679711 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:13:23.679711 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: from cryptography.utils import int_from_bytes Jul 27 15:13:26.361675 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:13:26.362179 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:13:26.362302 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:13:26.362687 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:13:26.362944 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:13:26.363324 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:13:26.363721 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.363820 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:13:26.363908 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.363987 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.364069 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:13:26.364241 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.364345 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:13:26.364564 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.364668 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:13:26.364871 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.364968 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.365186 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.365271 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.365500 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.365592 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.365824 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.365919 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.366082 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.366192 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.366395 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.366515 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.366740 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-2-iscsi {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.366836 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.367060 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.367145 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.367364 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.367449 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.368225 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.368319 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.368542 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.368627 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.368842 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.368926 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-2-iscsi {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.369159 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.369245 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.369461 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.369611 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.369775 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.369963 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.370082 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.370389 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.370518 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.370718 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.370795 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.371025 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.371102 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.371354 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.371536 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.371665 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.371842 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.371971 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.372147 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.372288 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.372455 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.372592 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.372786 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.372910 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.373095 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.373212 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.373400 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.373598 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-2-iscsi {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.373717 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.373913 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.374007 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.374222 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.374316 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.374565 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.374665 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.374970 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.375059 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-2-iscsi {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.375277 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.375365 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.375579 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.375676 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.375894 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.375996 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.376220 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.376323 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.376525 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.376616 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.376847 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.376949 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.377162 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.377251 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.377477 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.377566 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.377780 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.377872 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.378080 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.378175 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.378378 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.378491 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.378709 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.378797 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379027 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379140 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379325 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379419 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379623 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379773 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379857 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.379996 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.380160 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.380257 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.380477 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.380571 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.380793 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.380893 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381040 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381127 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381344 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381477 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381647 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381731 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381890 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.381984 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.382204 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.382298 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.382522 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.382612 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.382773 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.382860 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.383089 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.383212 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.383431 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.383524 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.383732 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.383819 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.384033 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.384127 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.384332 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.384417 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.384632 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.384737 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.384929 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.385028 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.385230 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.385324 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.385532 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.385619 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.385832 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.385929 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.386145 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.386237 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.386454 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.386577 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.386789 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.386877 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.387090 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.387177 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.387403 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.387494 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.387726 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.387813 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.388028 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.388115 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.388327 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.388411 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.388644 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.388737 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.388943 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.389044 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.389247 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.389353 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.389546 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.389637 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.389860 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.389946 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.390161 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.390254 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.390480 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.390569 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.390733 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.390820 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.391030 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.391129 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.391329 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.391422 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.391640 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.391735 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.391909 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.392052 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.392207 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.392293 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.392506 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.392599 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.392800 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.392896 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.393099 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.393192 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.393398 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.393489 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.393697 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.393791 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.393991 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.394081 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.394288 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.394381 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.394611 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.394712 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.394913 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.395021 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.395209 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.395301 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.395506 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.395593 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.395802 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.395886 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.396104 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.396198 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.396404 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.396492 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.396699 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.396792 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.396998 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.397085 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.397296 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.397385 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.397602 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.397688 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.397899 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.397984 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.398198 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.398284 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.398517 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.398621 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.398846 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.398936 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.399148 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.399256 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.399446 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.399542 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.399748 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.399835 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.400048 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.400139 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.400347 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.400444 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.400642 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.400727 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.400939 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.401026 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.401238 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.401323 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.401538 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.401624 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.401833 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.401924 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.402128 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.402214 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.402427 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.402541 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.402756 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.402843 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.403053 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.403139 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.403350 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.403480 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.403646 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.403733 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.403939 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.404025 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.404237 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.404336 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.404536 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.404631 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.404836 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.404939 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.405134 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.405242 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.405432 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.405525 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.405744 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.405837 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.406044 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.406130 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.406345 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.406431 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.406670 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.406758 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.406986 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:13:26.407075 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.407317 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.407417 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.407645 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.407733 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.407972 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.408060 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.408280 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.408368 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.408592 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.408680 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.408915 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.409004 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.409224 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.409311 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.409532 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.409635 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.409839 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.409927 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.410151 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.410238 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.410460 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.410586 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.410791 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.410878 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.411103 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.411189 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.411413 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.411522 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.411727 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.411815 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.412031 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.412117 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.412342 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.412438 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.412653 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.412739 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.412970 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.413064 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.413278 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.413376 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.413590 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.413683 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.413914 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.414012 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.414233 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.414328 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.415090 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.415235 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.415401 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.415498 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.415724 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.415820 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.416031 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.416118 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.416338 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.416427 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.416649 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.416737 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.416962 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.417051 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.417268 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.417356 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.417574 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.417661 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.417884 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.417970 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.418199 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.418298 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.418531 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.418621 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.418835 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.418922 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.419137 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.419223 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.419437 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.419572 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.419743 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.419830 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.420044 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.420178 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.420351 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.420482 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.420656 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.420743 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.420959 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.421053 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.421259 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.421344 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.421575 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.421660 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.421881 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.421994 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.422188 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.422287 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.422498 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.422589 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.422811 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.422915 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.423119 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.423207 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.423420 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.423507 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.423722 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.423816 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.424031 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.424120 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.424331 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.424426 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.424635 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.424722 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.424936 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.425021 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.425238 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.425380 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.425543 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.425630 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.425846 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.425931 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.426151 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.426236 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.426454 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.426564 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.426786 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.426882 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.427092 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.427178 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.427397 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.427493 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.427702 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.427794 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.428277 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.428380 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.428590 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.428676 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.428895 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.428981 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.429215 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.429308 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.429527 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.429616 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.429826 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.429919 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.430704 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.430834 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.431013 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.431112 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.431315 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.431411 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.431617 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.431787 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.431927 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.432027 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.432225 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.432311 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.432523 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.432612 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.432822 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.432909 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.433120 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.433207 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.433420 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.433509 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.433722 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.433810 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.434026 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.434113 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.434322 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.434416 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.434646 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.434733 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.434945 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.435039 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.435263 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.435349 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.435564 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.435651 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.435866 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.435955 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.436166 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.436262 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.436488 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.436575 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.436795 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.436894 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.437100 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.437186 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.437400 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.437493 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.437700 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.437795 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.438004 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.438091 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.438320 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.438406 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.438644 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.438745 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.438945 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.439032 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.439241 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.439328 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.439546 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.439647 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.439849 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.439941 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.440155 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.440248 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.440456 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.440560 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.440808 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.440914 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.441071 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.441159 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.441375 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.441464 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.441678 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.441765 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.441983 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.442069 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.442279 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.442367 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.442602 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.442692 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.442910 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.443009 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.443217 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.443304 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.443517 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.443603 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.443819 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.443905 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.444118 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.444215 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.444426 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.444514 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.444730 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.444824 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.445032 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.445127 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.445327 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.445415 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.445651 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.445750 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.445957 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.446051 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.446262 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.446350 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.446592 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.446698 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.446903 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.446991 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.447200 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.447287 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.447500 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.447595 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.447817 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.447904 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.448123 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.448210 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.448423 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.448518 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.448722 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.448811 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.449020 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.449107 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.449333 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.449428 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.449633 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.449721 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.449933 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.450019 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.450232 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.450332 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.450571 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.450662 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.450915 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.451027 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.451184 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.451271 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.451488 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.451576 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.451794 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.451920 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.452110 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.452197 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.452409 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.452494 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.452714 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.452807 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.453019 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.453108 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.453323 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.453411 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.453628 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.453726 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.453931 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.454018 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.454237 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.454323 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.454567 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.454668 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.454873 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.454966 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.455177 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.455270 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.455476 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.455572 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.455780 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.455874 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.456086 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.456171 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.456394 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.456644 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.456733 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.456980 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.457148 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.457292 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.457391 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.457607 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.457852 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.457947 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.458182 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.458269 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.458520 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.458612 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.458839 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.458937 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.459157 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.459251 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.459458 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.459544 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.459763 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.459849 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.460063 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.460156 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.460364 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.460491 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.460670 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.460764 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461025 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461135 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461289 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461380 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461592 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461686 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461896 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.461997 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.462196 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.462283 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.462516 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.462607 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.462817 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.462918 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.463118 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.463205 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.463417 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.463503 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.463713 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.463807 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464011 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464096 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464307 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464393 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464614 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464709 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464913 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.464999 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.465211 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.465299 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.465510 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.465597 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.465806 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.465892 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.466123 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.466209 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.466424 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.466582 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.466749 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.466836 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.467049 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.467135 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.467387 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.467475 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.467688 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.467782 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.468006 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.468093 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.468326 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.468415 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.468627 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.468715 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.468927 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.469026 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.469224 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.469311 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.469530 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.469617 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.469835 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.469931 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.470135 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.470227 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.470437 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.470599 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.470765 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.470869 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.471138 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.471237 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.471371 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.471466 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.471667 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.471753 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.471971 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.472060 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.472270 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.472367 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.472574 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.472667 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.472873 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.472969 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.473169 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.473262 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.473466 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.473552 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.473767 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.473862 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.474069 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.474154 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.474367 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.474651 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.474739 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.474837 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.474983 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.475071 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.475293 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.475380 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.475594 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.475690 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.475893 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.475980 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.476193 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.476282 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.476499 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.476595 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.476800 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.477393 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.477615 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.477702 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.477915 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.478009 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.478222 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.478310 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.478542 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.478632 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.478844 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.478932 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.479142 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.479236 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.479439 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.479526 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.479744 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.479833 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.480047 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.480133 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.480348 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.480436 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.480645 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.480739 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.480949 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.481043 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.481246 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.481345 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.481541 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.481630 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.481839 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.481927 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.482142 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.482238 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.482439 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.482552 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.482760 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.482847 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.483057 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.483157 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.483355 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.483451 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.483651 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.483739 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.483948 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.484113 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.484247 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.484336 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.484541 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.484627 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.484839 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.484937 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.485134 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.485227 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.485451 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.485543 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.485753 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.485848 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.486055 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.486146 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.486355 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.486450 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.486710 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.486801 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.487008 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.487094 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.487322 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.487415 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.487627 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.487716 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.487934 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.488030 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.488235 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.488322 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.488544 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.488638 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.488848 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.488935 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.489154 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.489241 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.489452 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.489541 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.489751 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.489839 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.490056 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.490150 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.490360 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.490448 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.490685 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.490771 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.490985 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.491084 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.491309 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.491427 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.491612 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.491700 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.491907 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.492002 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.492211 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.492306 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.492533 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.493129 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.493397 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.493494 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.493702 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.493789 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.494007 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.494092 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.494310 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.494404 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.494641 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.494741 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.494947 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.495032 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.495251 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.495339 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.495555 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.495643 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.495856 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.495950 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.496161 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.496258 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.496465 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.496558 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.496766 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.496854 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.497064 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.497157 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.497370 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.497457 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.497674 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.497759 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.497975 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.498062 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.498273 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.498358 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.498603 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.498713 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.498905 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.498992 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.499210 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.499325 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.499512 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.499633 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.499820 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.499939 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.500121 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.500240 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.500542 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.500641 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.500848 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.500935 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.501159 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.501246 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.501461 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.501567 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.501759 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.501853 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.502064 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.502170 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.502378 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.502487 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.502714 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.502846 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.503018 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.503105 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.503377 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.503464 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.503675 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.503762 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.503982 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.504076 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.504302 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.504391 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.504604 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.504691 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.504904 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.504989 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.505203 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.505292 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.505522 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.505608 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.505822 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.505906 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.506127 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.506215 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.506429 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.506678 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.506766 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.507029 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.507119 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.507369 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.507454 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.507786 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.507874 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.508114 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.508212 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.508429 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.508523 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.508843 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.508930 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.509154 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.509251 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.509464 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.509551 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.509785 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.509872 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.510106 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.510200 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.510428 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.510553 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.510754 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.510894 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.511068 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.511251 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.511380 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.511597 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.511696 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.511946 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.512037 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.512285 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.512380 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.512607 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.512692 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.512912 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.513007 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.513235 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.513329 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.513555 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.513649 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.513869 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.514091 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.514178 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.514449 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.514615 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.514815 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.514939 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.515249 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.515335 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.515570 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.515689 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.515894 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.516109 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.516202 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.516494 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.516579 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.516804 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.516940 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.517110 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.517363 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.517450 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.517723 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.517809 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.518029 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.518209 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.518338 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.518650 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.518754 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.518974 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.519069 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.519278 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.519526 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.519620 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.519886 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.519971 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.520187 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.520356 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.520505 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.520775 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.520862 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.521132 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.521218 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.521451 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.521618 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.521759 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.522053 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.522150 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.522373 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.522496 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.522702 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.522938 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.523027 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.523297 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.523384 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.523637 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.523799 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.524033 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.524264 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.524365 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.524675 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.524769 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.525003 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.525091 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.525313 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.525493 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.525646 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.525909 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.526007 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.526268 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.526355 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.526609 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.526804 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.526932 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.527159 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.527246 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.527524 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.527636 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.527827 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.527923 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.528131 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.528219 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.528435 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.528560 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.528739 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.528916 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.529045 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.529261 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.529358 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.529609 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.529705 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.529923 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.530016 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.530245 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.530340 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.530574 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.530677 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.530897 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.530991 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.531213 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.531301 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.531516 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.531604 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.531821 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.531917 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.532127 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.532253 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.532466 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.532589 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.532769 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.532925 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.533103 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.533260 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.533419 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.533614 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.533740 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.533952 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.534067 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.534303 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.534401 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.534671 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.534761 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.535009 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.535145 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.535322 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.535409 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.535634 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.535721 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.535945 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.536033 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.536259 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.536346 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.536569 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.536707 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.536880 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.537058 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.537188 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.537420 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.537507 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.537778 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.537867 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.538097 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.538200 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.538497 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.538641 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.538832 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.538972 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.539178 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.539278 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.540033 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.540125 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.540382 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.540469 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.540706 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.540794 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.541019 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.541106 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.541330 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.541417 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.541647 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.541736 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.541957 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.542044 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.542267 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.542361 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.542614 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.542735 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.542944 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.543277 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.543374 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.543618 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.543707 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.543936 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.544030 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.544253 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.544367 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.544569 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.544720 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.544891 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.545084 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.545256 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.545428 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.545578 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.545779 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.545888 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.546144 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.546238 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.546538 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.546629 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.546918 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.547015 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.547281 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.547369 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.547645 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.547734 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.547999 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.548087 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.548359 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.548446 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.548704 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.548792 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.549051 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.549144 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.549401 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.549496 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.549752 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.549839 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.550123 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.550211 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.550514 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.550618 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.550846 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.550942 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.551212 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.551299 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.551570 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.551661 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.551953 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.552053 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.552273 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.552516 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.552612 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.552876 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.552963 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.553464 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.553551 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.553782 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.553878 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.554092 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.554224 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.554406 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.554599 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.554749 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.554959 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.555134 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.555876 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.555968 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.556223 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.556318 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.556563 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.556649 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.556875 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.556964 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.557189 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.557286 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.557577 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.557705 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.557939 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.558026 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.558289 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.558450 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.558655 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.558755 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.558973 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.559060 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.559284 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.559381 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.559597 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.559918 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.560005 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.560219 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.560316 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.560520 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.560657 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.560826 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.561026 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.561121 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.561393 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.561526 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.561723 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.561810 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.562030 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.562169 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.562331 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.562441 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.562673 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.562810 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.562980 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.563156 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.563507 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.563597 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.563849 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.563937 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.564162 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.564260 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.564483 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.564571 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.564805 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.564894 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.565120 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.565217 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.565425 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.565513 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.565745 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.565877 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.566048 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.566172 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.566348 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.566554 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.566685 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.566902 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.566989 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.567245 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.567335 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.567565 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.567651 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.567878 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.567966 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.568184 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.568273 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.568484 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.568578 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.568789 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.568885 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.569088 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.569229 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.569411 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.569579 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.569721 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.569925 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.570031 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.570271 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.570358 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.570667 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.570759 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.570976 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.571065 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.571278 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.571379 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.571582 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.571726 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.571885 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.572071 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.572194 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.572431 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.572519 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.572774 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.572875 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.573076 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.573162 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.573381 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.573469 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.573683 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.573779 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.573990 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.574140 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.574291 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.574504 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.574632 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.574853 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.574940 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.575222 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.575310 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.575535 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.575635 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.575847 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.576168 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.576257 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.576474 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.576562 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.576779 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.576868 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.577119 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.577244 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.577430 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.577619 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.577962 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.578049 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.578294 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.578383 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.578638 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.578742 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.578978 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.579073 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.579314 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.579408 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.579619 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.579718 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.579922 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.580083 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.580224 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.580430 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.580542 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.580785 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.580875 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.581144 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.581230 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.581451 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.581701 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.581789 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.582049 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.582135 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.582357 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.582443 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.582798 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.582896 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.583165 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.583260 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.583475 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.583563 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.583784 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.583897 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.584120 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.584250 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.584435 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.584602 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.584748 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.584950 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.585046 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.585295 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.585390 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.585655 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.585742 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.585962 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.586167 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.586822 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.587109 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.587211 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.587419 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.587513 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.587747 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.587838 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.588055 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.588149 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.588361 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.588475 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.588775 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.588863 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.589083 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.589172 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.589400 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.589487 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.589712 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.589819 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.590019 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.590115 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.590343 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.590431 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.590701 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.590791 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.591026 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.591115 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.591334 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.591422 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.591634 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.591720 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.591936 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.592026 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.592237 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.592324 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.592545 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.592645 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.592882 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.592970 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.593205 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.593290 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.593517 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.593611 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.593826 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.593913 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.594132 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.594225 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.594442 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.594606 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.594772 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.594867 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.595077 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.595170 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.595382 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.595478 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.595687 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.595775 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.596002 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.596096 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.596308 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.596404 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.596622 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.596708 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.596927 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.597021 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.597245 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.597333 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.597548 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.597634 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.597858 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.597944 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.598159 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.598254 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.598498 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.598587 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.598803 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.598898 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.599112 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.599201 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.599435 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.599523 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.599742 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.599836 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.600059 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.600154 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.600361 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.600449 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.600676 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.600775 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.600978 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.601065 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.601294 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.601381 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.601604 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.601699 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.601962 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.602589 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.602780 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.602867 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.603101 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.603200 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.603409 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.603503 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.603716 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.603811 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.604019 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.604115 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.604325 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.604413 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.604632 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.604718 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.604935 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.605022 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.605255 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.605350 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.605559 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.605644 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.605865 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.605953 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.606184 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.606315 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.606511 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.606603 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.606831 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.606919 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.607140 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.607228 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.607443 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.607538 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.607759 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.607846 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.608061 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.608147 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.608364 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.608458 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.608666 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.608752 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.608971 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.609066 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.609279 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.609373 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.609587 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.609681 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.609907 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.610002 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.610227 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.610313 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.610567 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.610655 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.610891 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.610980 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.611210 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.611297 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.611529 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.611616 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.611907 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.612041 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.612141 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:13:26.612223 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:13:26.612428 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:13:26.634406 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_db.sqlalchemy.engines [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:26.635345 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_db.sqlalchemy.engines [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:26.711113 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.context [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ff5b841-e3d6-4f57-b836-5edd3f142ad2(cell1) {{(pid=92348) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:13:26.711801 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.context [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ff5b841-e3d6-4f57-b836-5edd3f142ad2(cell1) {{(pid=92349) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:13:26.715838 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_concurrency.lockutils [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:13:26.715978 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:13:26.717422 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_concurrency.lockutils [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:13:26.717539 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:13:26.718226 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_concurrency.lockutils [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:13:26.718390 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:13:26.720171 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_concurrency.lockutils [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:13:26.720266 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:13:26.732884 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_db.sqlalchemy.engines [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:26.733997 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_db.sqlalchemy.engines [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:26.736527 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_db.sqlalchemy.engines [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:26.739368 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_db.sqlalchemy.engines [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:27.092408 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_db.sqlalchemy.engines [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:27.095327 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG oslo_db.sqlalchemy.engines [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:13:27.432268 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: WARNING keystonemiddleware.auth_token [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:13:27.435338 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: WARNING keystonemiddleware.auth_token [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:13:27.438702 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: WARNING keystonemiddleware.auth_token [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:13:27.441845 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: WARNING keystonemiddleware.auth_token [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:13:27.780053 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: WARNING keystonemiddleware.auth_token [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:13:27.783933 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: WARNING keystonemiddleware.auth_token [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:13:27.785158 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: WARNING keystonemiddleware.auth_token [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:13:27.789158 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: WARNING keystonemiddleware.auth_token [None req-7c3cc7a3-3124-40c0-849b-abc952abde23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:13:27.790830 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba60b759c0 pid: 92348 (default app) Jul 27 15:13:27.792914 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:13:27.794080 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Jul 27 15:13:27.794501 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 789 bytes} [Tue Jul 27 15:13:27 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:13:27.794859 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba60b759c0 pid: 92349 (default app) Jul 27 15:14:46.703888 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:14:46.704899 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 27 15:14:46.705300 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 2/2] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:14:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:14:47.120812 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-36180777-8e06-4745-800c-4c1652e03f79 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:14:47.151290 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-36180777-8e06-4745-800c-4c1652e03f79 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.438168 Jul 27 15:14:47.158524 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 1/3] 10.222.0.37 () {60 vars in 1292 bytes} [Tue Jul 27 15:14:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:14:49.327682 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:14:49.328694 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-a77bcf29-1717-4f0c-bb32-ae2888c41609 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 27 15:14:49.329104 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 3/4] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:14:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:14:49.393837 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-3c284f77-01c9-4d5f-b7be-08bbd187205e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:49.414916 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:14:49.414916 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: warnings.warn(msg) Jul 27 15:14:49.445159 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-3c284f77-01c9-4d5f-b7be-08bbd187205e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108672 Jul 27 15:14:49.446612 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 2/5] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:14:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:14:49.666077 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-2861498a-bc03-4f46-aeb5-7ccaf2f421fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:49.668544 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:14:49.668544 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: warnings.warn(msg) Jul 27 15:14:49.717109 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-2861498a-bc03-4f46-aeb5-7ccaf2f421fe admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262828 Jul 27 15:14:49.723096 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 4/6] 10.222.0.37 () {64 vars in 1336 bytes} [Tue Jul 27 15:14:49 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:14:51.888848 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-3c284f77-01c9-4d5f-b7be-08bbd187205e admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:14:51.889854 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-3c284f77-01c9-4d5f-b7be-08bbd187205e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 27 15:14:51.890439 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 3/7] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:14:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:14:51.996190 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-58b730a5-c1e0-43a5-94d2-4169e48c25ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "vcpus": 1, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:52.014144 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:14:52.014144 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: warnings.warn(msg) Jul 27 15:14:52.033113 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-58b730a5-c1e0-43a5-94d2-4169e48c25ac admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135298 Jul 27 15:14:52.033952 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 5/8] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:14:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:14:52.045704 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-bf817300-d62e-4c2b-8b18-65d845a74ca7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:52.047198 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:14:52.047198 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: warnings.warn(msg) Jul 27 15:14:52.078770 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-bf817300-d62e-4c2b-8b18-65d845a74ca7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036571 Jul 27 15:14:52.079357 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 4/9] 10.222.0.37 () {64 vars in 1336 bytes} [Tue Jul 27 15:14:52 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:14:54.221215 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-58b730a5-c1e0-43a5-94d2-4169e48c25ac admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:14:54.222247 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-58b730a5-c1e0-43a5-94d2-4169e48c25ac admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 27 15:14:54.222899 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 6/10] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:14:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:14:54.285061 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-cd425bbb-4909-4dce-a79b-b0ec5c91b89f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:54.305399 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-cd425bbb-4909-4dce-a79b-b0ec5c91b89f admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075595 Jul 27 15:14:54.306152 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 5/11] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:14:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:14:54.318288 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-1250c90e-a02f-434e-82bc-68f2a50e0fde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:54.341064 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-1250c90e-a02f-434e-82bc-68f2a50e0fde admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026773 Jul 27 15:14:54.350580 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 7/12] 10.222.0.37 () {64 vars in 1336 bytes} [Tue Jul 27 15:14:54 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:14:56.536842 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-cd425bbb-4909-4dce-a79b-b0ec5c91b89f admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:14:56.538692 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-cd425bbb-4909-4dce-a79b-b0ec5c91b89f admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003079 Jul 27 15:14:56.539090 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 6/13] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:14:56 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:14:56.596340 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-d7ee1e39-c73e-4ea0-82e3-c9ab7de2a222 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G"}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:56.618405 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-d7ee1e39-c73e-4ea0-82e3-c9ab7de2a222 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068727 Jul 27 15:14:56.618405 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 8/14] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:14:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:14:56.631406 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0e19908a-b36e-42eb-9cb8-afc4f0835586 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:56.659302 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0e19908a-b36e-42eb-9cb8-afc4f0835586 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031672 Jul 27 15:14:56.660293 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 7/15] 10.222.0.37 () {64 vars in 1336 bytes} [Tue Jul 27 15:14:56 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:14:58.823556 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-d7ee1e39-c73e-4ea0-82e3-c9ab7de2a222 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:14:58.824558 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-d7ee1e39-c73e-4ea0-82e3-c9ab7de2a222 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 27 15:14:58.824953 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 9/16] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:14:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:14:58.882287 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-a32a1586-8631-45d3-9d7a-785e55e722f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:58.901623 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-a32a1586-8631-45d3-9d7a-785e55e722f5 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070190 Jul 27 15:14:58.902150 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 8/17] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:14:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:14:58.914830 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-49b422a9-88ad-465a-91a7-1916782948a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:14:58.942918 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-49b422a9-88ad-465a-91a7-1916782948a3 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032372 Jul 27 15:14:58.943548 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 10/18] 10.222.0.37 () {64 vars in 1336 bytes} [Tue Jul 27 15:14:58 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:15:01.112030 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-a32a1586-8631-45d3-9d7a-785e55e722f5 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:01.113030 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-a32a1586-8631-45d3-9d7a-785e55e722f5 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 27 15:15:01.113969 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 9/19] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:15:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:01.168597 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-b415a31d-9961-4f0a-bc05-dd493faab20d admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:01.192108 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-b415a31d-9961-4f0a-bc05-dd493faab20d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.071849 Jul 27 15:15:01.192854 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 11/20] 10.222.0.37 () {60 vars in 1292 bytes} [Tue Jul 27 15:15:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:15:03.357214 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-a32a1586-8631-45d3-9d7a-785e55e722f5 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:03.358567 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-a32a1586-8631-45d3-9d7a-785e55e722f5 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Jul 27 15:15:03.359119 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 10/21] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:15:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:03.416808 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-a9f6cee5-01b3-48fc-9ba9-40e85ef2cb8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "disk": 1, "vcpus": 1, "id": "1"}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:03.434948 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-a9f6cee5-01b3-48fc-9ba9-40e85ef2cb8f admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069260 Jul 27 15:15:03.435491 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 12/22] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:15:03 2021] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:15:03.448808 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-4da5ce88-2149-4a1f-a205-760e3b95e306 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:03.474076 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-4da5ce88-2149-4a1f-a205-760e3b95e306 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029644 Jul 27 15:15:03.474946 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 11/23] 10.222.0.37 () {64 vars in 1333 bytes} [Tue Jul 27 15:15:03 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:15:05.628498 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-a9f6cee5-01b3-48fc-9ba9-40e85ef2cb8f admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:05.630016 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-a9f6cee5-01b3-48fc-9ba9-40e85ef2cb8f admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Jul 27 15:15:05.630416 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 13/24] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:15:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:05.699362 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-e8433520-d6cb-430e-b844-52c39dd5ac68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:05.717075 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-e8433520-d6cb-430e-b844-52c39dd5ac68 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080179 Jul 27 15:15:05.717626 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 12/25] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:15:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:15:05.730151 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-e7eba278-0f5d-488e-8922-39c6753bc78f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:05.753202 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-e7eba278-0f5d-488e-8922-39c6753bc78f admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026659 Jul 27 15:15:05.753793 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 14/26] 10.222.0.37 () {64 vars in 1333 bytes} [Tue Jul 27 15:15:05 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:15:08.143046 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-e8433520-d6cb-430e-b844-52c39dd5ac68 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:08.144059 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-e8433520-d6cb-430e-b844-52c39dd5ac68 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 27 15:15:08.144495 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 13/27] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:15:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:08.199303 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-46fb39b8-dc4b-4b2e-b392-c083d9bdcc27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 40, "ram": 4096}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:08.216756 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-46fb39b8-dc4b-4b2e-b392-c083d9bdcc27 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.066098 Jul 27 15:15:08.217284 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 15/28] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:15:08 2021] POST /compute/v2.1/flavors => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:15:08.229864 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-790f8ac6-89bf-47cf-bb3e-3beb7483132c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:08.252331 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-790f8ac6-89bf-47cf-bb3e-3beb7483132c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026239 Jul 27 15:15:08.252872 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 14/29] 10.222.0.37 () {64 vars in 1333 bytes} [Tue Jul 27 15:15:08 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:15:10.441275 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-46fb39b8-dc4b-4b2e-b392-c083d9bdcc27 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:10.442263 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-46fb39b8-dc4b-4b2e-b392-c083d9bdcc27 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 27 15:15:10.442744 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 16/30] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:15:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:10.498884 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-6008c634-2b0a-45f7-bd3e-1291f4255c4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:10.522220 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-6008c634-2b0a-45f7-bd3e-1291f4255c4c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073063 Jul 27 15:15:10.522741 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 15/31] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:15:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:15:10.534308 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-158ac751-67ed-4314-83a1-68aff3425089 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:10.557026 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-158ac751-67ed-4314-83a1-68aff3425089 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026263 Jul 27 15:15:10.557586 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 17/32] 10.222.0.37 () {64 vars in 1333 bytes} [Tue Jul 27 15:15:10 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:15:12.742026 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-6008c634-2b0a-45f7-bd3e-1291f4255c4c admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:12.743615 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-6008c634-2b0a-45f7-bd3e-1291f4255c4c admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 Jul 27 15:15:12.744000 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 16/33] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:15:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:12.817114 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-05b55273-e83a-44f9-90b4-437b11ab1b98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "name": "m1.xlarge", "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:12.836663 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-05b55273-e83a-44f9-90b4-437b11ab1b98 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.086412 Jul 27 15:15:12.837289 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 18/34] 10.222.0.37 () {64 vars in 1283 bytes} [Tue Jul 27 15:15:12 2021] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:15:12.849012 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-63374bda-94f7-494a-bc82-2a7ea767425b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:12.875329 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-63374bda-94f7-494a-bc82-2a7ea767425b admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029855 Jul 27 15:15:12.883074 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 17/35] 10.222.0.37 () {64 vars in 1333 bytes} [Tue Jul 27 15:15:12 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:15:52.468351 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-05b55273-e83a-44f9-90b4-437b11ab1b98 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:52.469355 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-05b55273-e83a-44f9-90b4-437b11ab1b98 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 27 15:15:52.469749 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 19/36] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:15:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:52.524364 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-8dff1e5b-230c-45b6-9b9a-a79ddb224502 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:52.540671 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-8dff1e5b-230c-45b6-9b9a-a79ddb224502 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.064577 Jul 27 15:15:52.541196 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 18/37] 10.222.0.37 () {60 vars in 1292 bytes} [Tue Jul 27 15:15:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:15:53.950491 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-05b55273-e83a-44f9-90b4-437b11ab1b98 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:53.951542 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-05b55273-e83a-44f9-90b4-437b11ab1b98 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Jul 27 15:15:53.951942 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 20/38] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:15:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:54.136955 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-952604e4-9d97-40b8-84e7-fdf836d76324 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:54.142303 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.wsgi [None req-952604e4-9d97-40b8-84e7-fdf836d76324 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 15:15:54.142894 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-952604e4-9d97-40b8-84e7-fdf836d76324 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:15:54.143677 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-952604e4-9d97-40b8-84e7-fdf836d76324 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.055358 Jul 27 15:15:54.144171 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 19/39] 10.222.0.37 () {60 vars in 1191 bytes} [Tue Jul 27 15:15:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 15:15:54.153974 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-fbfeb386-632f-4089-8ca4-211416e113ba admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:54.174918 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-fbfeb386-632f-4089-8ca4-211416e113ba admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024695 Jul 27 15:15:54.175445 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 21/40] 10.222.0.37 () {60 vars in 1211 bytes} [Tue Jul 27 15:15:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:15:54.185063 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-f8d4397f-b40e-4c03-b39e-90cd599cb188 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:54.205818 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-f8d4397f-b40e-4c03-b39e-90cd599cb188 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024105 Jul 27 15:15:54.206331 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 20/41] 10.222.0.37 () {60 vars in 1211 bytes} [Tue Jul 27 15:15:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:15:54.215811 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-aaeb7fd1-f9d0-4b76-85a0-eb436e550590 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:54.220970 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.wsgi [None req-aaeb7fd1-f9d0-4b76-85a0-eb436e550590 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 15:15:54.221570 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-aaeb7fd1-f9d0-4b76-85a0-eb436e550590 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:15:54.222358 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-aaeb7fd1-f9d0-4b76-85a0-eb436e550590 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010040 Jul 27 15:15:54.222875 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 22/42] 10.222.0.37 () {60 vars in 1191 bytes} [Tue Jul 27 15:15:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 15:15:55.538620 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-f8d4397f-b40e-4c03-b39e-90cd599cb188 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:55.539614 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-f8d4397f-b40e-4c03-b39e-90cd599cb188 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 27 15:15:55.539999 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 21/43] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:15:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:55.731544 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-95ca916a-5125-4b0e-826c-7440218c054d admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:55.737186 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.wsgi [None req-95ca916a-5125-4b0e-826c-7440218c054d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 15:15:55.737743 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-95ca916a-5125-4b0e-826c-7440218c054d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:15:55.738552 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-95ca916a-5125-4b0e-826c-7440218c054d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.056170 Jul 27 15:15:55.739050 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 23/44] 10.222.0.37 () {60 vars in 1191 bytes} [Tue Jul 27 15:15:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 15:15:55.748718 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-63df6436-e5aa-4d87-b445-409b308c2b1a admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:55.762294 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-63df6436-e5aa-4d87-b445-409b308c2b1a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017186 Jul 27 15:15:55.762829 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 22/45] 10.222.0.37 () {60 vars in 1211 bytes} [Tue Jul 27 15:15:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:15:55.772163 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-1b363bf4-aad5-49f5-aed4-84ea1b1516f0 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:55.785289 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-1b363bf4-aad5-49f5-aed4-84ea1b1516f0 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016464 Jul 27 15:15:55.785813 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 24/46] 10.222.0.37 () {60 vars in 1211 bytes} [Tue Jul 27 15:15:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:15:55.795002 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-5642dbe5-2617-4625-a4ec-abb689309f80 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:55.800591 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.wsgi [None req-5642dbe5-2617-4625-a4ec-abb689309f80 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 15:15:55.801146 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-5642dbe5-2617-4625-a4ec-abb689309f80 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:15:55.801919 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-5642dbe5-2617-4625-a4ec-abb689309f80 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010294 Jul 27 15:15:55.802396 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 23/47] 10.222.0.37 () {60 vars in 1191 bytes} [Tue Jul 27 15:15:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 15:15:57.124090 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-1b363bf4-aad5-49f5-aed4-84ea1b1516f0 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:57.125072 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-1b363bf4-aad5-49f5-aed4-84ea1b1516f0 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Jul 27 15:15:57.125460 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 25/48] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:15:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:57.311712 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-784f6de0-1770-4111-a1ca-7fb08de0b543 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:57.318955 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.wsgi [None req-784f6de0-1770-4111-a1ca-7fb08de0b543 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 15:15:57.319517 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-784f6de0-1770-4111-a1ca-7fb08de0b543 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:15:57.320304 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-784f6de0-1770-4111-a1ca-7fb08de0b543 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.056232 Jul 27 15:15:57.320790 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 24/49] 10.222.0.37 () {60 vars in 1194 bytes} [Tue Jul 27 15:15:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 15:15:57.330524 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-468090f0-4fcf-472c-a9bb-cc1e2559dddb admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:57.343748 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-468090f0-4fcf-472c-a9bb-cc1e2559dddb admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016710 Jul 27 15:15:57.344253 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 26/50] 10.222.0.37 () {60 vars in 1211 bytes} [Tue Jul 27 15:15:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:15:57.354181 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:57.367742 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016861 Jul 27 15:15:57.368197 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 25/51] 10.222.0.37 () {60 vars in 1211 bytes} [Tue Jul 27 15:15:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:15:57.377437 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-ac25de9e-ac21-44c8-8dc1-73b566aaa81d admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:57.382283 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.wsgi [None req-ac25de9e-ac21-44c8-8dc1-73b566aaa81d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 15:15:57.382862 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-ac25de9e-ac21-44c8-8dc1-73b566aaa81d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:15:57.383631 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-ac25de9e-ac21-44c8-8dc1-73b566aaa81d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009575 Jul 27 15:15:57.384108 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 27/52] 10.222.0.37 () {60 vars in 1194 bytes} [Tue Jul 27 15:15:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 15:15:58.706869 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:15:58.707872 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 27 15:15:58.708265 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 26/53] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:15:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:15:58.897421 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-e7e1c23e-550d-4b2a-925f-c76bcd905bf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:15:58.915915 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-e7e1c23e-550d-4b2a-925f-c76bcd905bf3 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.068312 Jul 27 15:15:58.916379 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 28/54] 10.222.0.37 () {64 vars in 1236 bytes} [Tue Jul 27 15:15:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:16:00.240842 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:00.241820 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jul 27 15:16:00.242214 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 27/55] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:16:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:16:00.428741 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-0f835ffa-dae4-488c-8345-e3501266cef7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:16:00.445256 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-0f835ffa-dae4-488c-8345-e3501266cef7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.065716 Jul 27 15:16:00.445772 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 29/56] 10.222.0.37 () {64 vars in 1236 bytes} [Tue Jul 27 15:16:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:16:01.776121 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:01.777122 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jul 27 15:16:01.777510 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 28/57] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:16:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:16:01.963566 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-2488ecbd-9bf2-410e-8ec4-1990c3be9373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:16:01.981207 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-2488ecbd-9bf2-410e-8ec4-1990c3be9373 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.065731 Jul 27 15:16:01.981741 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 30/58] 10.222.0.37 () {64 vars in 1236 bytes} [Tue Jul 27 15:16:01 2021] POST /compute/v2.1/flavors => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:16:03.317738 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:03.318771 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 27 15:16:03.319181 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 29/59] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:16:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:16:03.504321 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-70acf826-bcf0-4ffd-94b8-5b0f24333517 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:16:03.521813 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-70acf826-bcf0-4ffd-94b8-5b0f24333517 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.064660 Jul 27 15:16:03.522341 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 31/60] 10.222.0.37 () {64 vars in 1236 bytes} [Tue Jul 27 15:16:03 2021] POST /compute/v2.1/flavors => generated 409 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:16:04.852570 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:04.853558 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jul 27 15:16:04.853952 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 30/61] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:16:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:16:05.038119 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-ede67fbe-911f-4c51-8ac4-30d00b5f9597 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:05.057274 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-ede67fbe-911f-4c51-8ac4-30d00b5f9597 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.067046 Jul 27 15:16:05.057789 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 32/62] 10.222.0.37 () {60 vars in 1203 bytes} [Tue Jul 27 15:16:04 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:16:51.078855 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:51.079873 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-0f32f5ff-23e0-4675-a013-6c305fbe2820 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 27 15:16:51.080264 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 31/63] 10.222.0.37 () {54 vars in 931 bytes} [Tue Jul 27 15:16:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:16:51.133883 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-18e29035-9d05-47a4-9702-7ae8090eec32 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:51.152619 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-18e29035-9d05-47a4-9702-7ae8090eec32 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.066202 Jul 27 15:16:51.153079 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 33/64] 10.222.0.37 () {60 vars in 1292 bytes} [Tue Jul 27 15:16:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:16:51.175826 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-115ed029-944c-4c2b-a7d3-7b637d285140 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:51.183389 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-115ed029-944c-4c2b-a7d3-7b637d285140 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012098 Jul 27 15:16:51.183892 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 32/65] 10.222.0.37 () {60 vars in 1283 bytes} [Tue Jul 27 15:16:51 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:16:51.195027 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-44aeafcb-c31f-447a-9ae3-c2a9fbefa1e7 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:51.202253 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-44aeafcb-c31f-447a-9ae3-c2a9fbefa1e7 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010629 Jul 27 15:16:51.202777 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 34/66] 10.222.0.37 () {60 vars in 1286 bytes} [Tue Jul 27 15:16:51 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:16:51.213821 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-306ec7bc-e8c1-4d05-ba23-e2c3cd9423db admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:51.221513 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-306ec7bc-e8c1-4d05-ba23-e2c3cd9423db admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011068 Jul 27 15:16:51.222020 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 33/67] 10.222.0.37 () {60 vars in 1286 bytes} [Tue Jul 27 15:16:51 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:16:51.232631 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:16:51.240315 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010897 Jul 27 15:16:51.240816 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 35/68] 10.222.0.37 () {60 vars in 1283 bytes} [Tue Jul 27 15:16:51 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:18:09.971605 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-8e8c8c6b-2c8a-48bd-9cc2-7b1638e27d80 tempest-verify_tempest_config-817475889 tempest-verify_tempest_config-817475889-project] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:18:09.973627 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-8e8c8c6b-2c8a-48bd-9cc2-7b1638e27d80 tempest-verify_tempest_config-817475889 tempest-verify_tempest_config-817475889-project] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103001 Jul 27 15:18:09.974170 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 34/69] 10.222.0.37 () {58 vars in 1134 bytes} [Tue Jul 27 15:18:09 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:19:41.247703 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:41.248708 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 27 15:19:41.249590 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 36/70] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:19:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:19:41.502843 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-aed80673-0a87-4796-9a2e-8a212c107068 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:41.503991 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:19:41.503991 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: warnings.warn(msg) Jul 27 15:19:41.505665 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-aed80673-0a87-4796-9a2e-8a212c107068 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:41.506098 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-aed80673-0a87-4796-9a2e-8a212c107068 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:41.506901 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-aed80673-0a87-4796-9a2e-8a212c107068 admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:41.507319 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-aed80673-0a87-4796-9a2e-8a212c107068 admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:41.540194 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-aed80673-0a87-4796-9a2e-8a212c107068 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.148564 Jul 27 15:19:41.540746 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 35/71] 10.222.0.37 () {60 vars in 1194 bytes} [Tue Jul 27 15:19:41 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:19:42.901005 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:42.901999 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 27 15:19:42.902384 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 37/72] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:19:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:19:43.090120 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-d2a1ef1b-73e8-4325-b2a9-2ec918bfc3bc admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:43.091298 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:19:43.091298 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: warnings.warn(msg) Jul 27 15:19:43.092849 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef1b-73e8-4325-b2a9-2ec918bfc3bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:43.093281 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef1b-73e8-4325-b2a9-2ec918bfc3bc admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:43.094065 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef1b-73e8-4325-b2a9-2ec918bfc3bc admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:43.094515 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef1b-73e8-4325-b2a9-2ec918bfc3bc admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:43.113374 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-d2a1ef1b-73e8-4325-b2a9-2ec918bfc3bc admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.072017 Jul 27 15:19:43.113847 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 36/73] 10.222.0.37 () {60 vars in 1194 bytes} [Tue Jul 27 15:19:43 2021] GET /compute/v2.1/os-services => generated 791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:19:54.865752 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:54.866789 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jul 27 15:19:54.867175 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 38/74] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:19:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:19:55.059654 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-8b16d6c1-74d3-48d2-a520-fa07a57bd416 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:55.060800 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:19:55.060800 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: warnings.warn(msg) Jul 27 15:19:55.062281 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-8b16d6c1-74d3-48d2-a520-fa07a57bd416 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:55.062755 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-8b16d6c1-74d3-48d2-a520-fa07a57bd416 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:55.063572 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-8b16d6c1-74d3-48d2-a520-fa07a57bd416 admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:55.063998 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-8b16d6c1-74d3-48d2-a520-fa07a57bd416 admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:55.087906 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-8b16d6c1-74d3-48d2-a520-fa07a57bd416 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.077042 Jul 27 15:19:55.088380 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 37/75] 10.222.0.37 () {60 vars in 1194 bytes} [Tue Jul 27 15:19:55 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:19:56.419813 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: DEBUG nova.api.openstack.wsgi [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] Calling method '>' {{(pid=92348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:56.420795 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: INFO nova.api.openstack.requestlog [None req-5d1c1578-d837-4fe7-963c-a2f6e1fdc415 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Jul 27 15:19:56.421185 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: [pid: 92348|app: 0|req: 39/76] 10.222.0.37 () {56 vars in 1075 bytes} [Tue Jul 27 15:19:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:19:56.607554 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG nova.api.openstack.wsgi [None req-3b3247ce-280b-472a-913a-072e33520570 admin admin] Calling method '>' {{(pid=92349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:19:56.608713 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:19:56.608713 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: warnings.warn(msg) Jul 27 15:19:56.610232 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-3b3247ce-280b-472a-913a-072e33520570 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:56.610712 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-3b3247ce-280b-472a-913a-072e33520570 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:56.611516 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-3b3247ce-280b-472a-913a-072e33520570 admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:19:56.611944 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: DEBUG oslo_concurrency.lockutils [None req-3b3247ce-280b-472a-913a-072e33520570 admin admin] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:19:56.632429 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: INFO nova.api.openstack.requestlog [None req-3b3247ce-280b-472a-913a-072e33520570 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.072942 Jul 27 15:19:56.632903 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: [pid: 92349|app: 0|req: 38/77] 10.222.0.37 () {60 vars in 1194 bytes} [Tue Jul 27 15:19:56 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:20:53.204405 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: Tue Jul 27 15:20:53 2021 - graceful shutdown triggered... Jul 27 15:20:53.204895 dv-cinder-800431-2-iscsi devstack@n-api.service[92348]: Gracefully killing worker 1 (pid: 92348)... Jul 27 15:20:53.204512 dv-cinder-800431-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 15:20:53.206250 dv-cinder-800431-2-iscsi devstack@n-api.service[92349]: Gracefully killing worker 2 (pid: 92349)... Jul 27 15:20:54.206085 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: worker 1 buried after 1 seconds Jul 27 15:20:54.206085 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: worker 2 buried after 1 seconds Jul 27 15:20:54.206085 dv-cinder-800431-2-iscsi devstack@n-api.service[92347]: goodbye to uWSGI. Jul 27 15:20:54.207585 dv-cinder-800431-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 15:20:54.208129 dv-cinder-800431-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 15:20:54.210949 dv-cinder-800431-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 15:20:54.219913 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 27 15:20:54 2021] *** Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: nodename: dv-cinder-800431-2-iscsi Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: machine: x86_64 Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: clock source: unix Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: pcre jit disabled Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: detected number of CPU cores: 4 Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: current working directory: / Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: detected binary path: /usr/bin/uwsgi-core Jul 27 15:20:54.222428 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: your processes number limit is 47680 Jul 27 15:20:54.223377 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: your memory page size is 4096 bytes Jul 27 15:20:54.223377 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: detected max file descriptor number: 2048 Jul 27 15:20:54.223377 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: lock engine: pthread robust mutexes Jul 27 15:20:54.223377 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: thunder lock: enabled Jul 27 15:20:54.223377 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 15:20:54.223377 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 27 15:20:54.266770 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: Python main interpreter initialized at 0x55c4b2b019c0 Jul 27 15:20:54.266770 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: python threads support enabled Jul 27 15:20:54.266770 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: your server socket listen backlog is limited to 100 connections Jul 27 15:20:54.266770 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: your mercy for graceful operations on workers is 90 seconds Jul 27 15:20:54.267192 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 15:20:54.267192 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: *** Operational MODE: preforking *** Jul 27 15:20:54.267477 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: *** uWSGI is running in multiple interpreter mode *** Jul 27 15:20:54.267477 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: spawned uWSGI master process (pid: 107311) Jul 27 15:20:54.267686 dv-cinder-800431-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 15:20:54.271156 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: spawned uWSGI worker 1 (pid: 107332, cores: 1) Jul 27 15:20:54.271657 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: spawned uWSGI worker 2 (pid: 107333, cores: 1) Jul 27 15:20:54.271965 dv-cinder-800431-2-iscsi devstack@n-api.service[107311]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 15:20:56.066065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:20:56.066065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: from cryptography.utils import int_from_bytes Jul 27 15:20:56.066811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:20:56.066811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: from cryptography.utils import int_from_bytes Jul 27 15:20:56.066959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:20:56.066959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: from cryptography.utils import int_from_bytes Jul 27 15:20:56.066959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:20:56.066959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: from cryptography.utils import int_from_bytes Jul 27 15:20:58.587553 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:20:58.588198 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:20:58.588198 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:20:58.588555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:20:58.588803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:20:58.589199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.589525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.589848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.590167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.590523 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.590842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.591164 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.591487 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.591813 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.592076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.592394 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.592726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-2-iscsi {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.593053 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.593362 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.593677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.593999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.594307 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.594666 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.594976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.595475 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.597520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.597520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.597520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.597520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.597863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:20:58.598249 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.598341 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:20:58.598421 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.598421 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.598911 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:20:58.599164 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.599409 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:20:58.599670 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.599885 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:20:58.600097 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.600374 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.600611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-2-iscsi {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.600837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.601115 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.601325 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.601555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.601767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.601987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.602232 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.602232 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.602715 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.602935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.603159 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.603159 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.603558 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.603782 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.603932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.603932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.604263 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.604453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.604600 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.604753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-2-iscsi {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.604924 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.605116 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.605277 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.605428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.605572 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.605715 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.605858 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.606014 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.606167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.606318 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.606552 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.606552 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.606869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.606869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.607152 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.607152 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.607423 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.607583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.607735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.607902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.608064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.608973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.609231 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.609402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.609560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.609720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.609865 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.610019 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.610019 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.610398 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.610601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.610766 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.610919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.611078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.611234 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.611399 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.611558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.612312 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.612461 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.612603 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-2-iscsi {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.612759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.612917 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.613068 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.613221 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.613375 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.613524 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.613684 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.613684 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.613989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.614135 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.614286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.614450 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.614644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.614802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.614981 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.615241 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.615401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.615546 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.615697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.615925 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.616083 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.616227 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.616370 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.616521 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.616679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.616841 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.616993 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.617183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.617334 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.617479 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.617636 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.617789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.617950 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.618112 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.618268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.619051 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.619238 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.619480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.619640 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.619640 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.619923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.620078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.620229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.620374 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.620517 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.620661 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.620827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.620982 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.621145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.621303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.621454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.621606 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.621754 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.621907 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.622200 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.622366 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.622548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.622713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.622871 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.623024 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.623175 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.623329 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.623482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.623482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.623769 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.623921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.624076 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.624220 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.624369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.624520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.624683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.624842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.624986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.625129 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.625271 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.625413 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.625565 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.625717 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.625867 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.626011 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.626165 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.626322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.626501 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.626680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.626826 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.626981 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.627141 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.627348 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.627506 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.627658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.627813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.627966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.628118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.628282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.628435 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.629238 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.629409 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.629677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.629838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.629991 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.630145 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.630290 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.630448 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.630619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.630763 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.630917 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.631062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.631218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.631388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.631544 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.631697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.631849 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.632002 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.632164 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.632361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.632513 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.632656 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.632809 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.632955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.633106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.633288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.633454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.633607 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.633759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.633911 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.634068 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.634231 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.634416 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.634593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.634745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.634890 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.635047 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.635210 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.635372 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.635527 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.635677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.635843 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.635995 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.636150 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.636311 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.636457 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.636618 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.636762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.636906 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.637048 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.637201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.637353 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.637530 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.637675 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.637818 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.637970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.638123 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.638266 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.638425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.638628 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.639301 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.639541 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.639710 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.639956 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.640124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.640271 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.640415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.640575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.640720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.640863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.640863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.641148 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.641307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.641459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.641613 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.641756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.641900 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.642062 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.642214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.642358 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.642520 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.642671 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.642830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.642991 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.643136 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.643279 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.643430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.643582 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.643727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.643880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.644042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.644201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.644347 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.644501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.644647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.644800 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.644952 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.645096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.645239 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.645382 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.645533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.645691 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.645847 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.645999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.646152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.646296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.646448 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.646632 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.646777 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.646929 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.647081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.647225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.647381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.647533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.647685 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.647849 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.648001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:20:58.648145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.648307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.648467 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.648612 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.648761 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.649421 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.649605 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.649605 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.650007 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.650251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.650410 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.650626 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.650775 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.650919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.651082 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.651248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.651403 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.651548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.651692 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.651845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.652140 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.652294 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.652439 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.652595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.652748 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.652906 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.653060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.653214 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.653367 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.653519 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.653519 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.653833 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.653986 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.654138 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.654289 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.654434 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.654624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.654785 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.654932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.655076 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.655230 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.655390 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.655552 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.655697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.655841 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.655992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.656138 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.656282 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.656439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.656602 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.656763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.656915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.657059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.657059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.657341 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.657717 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.657892 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.658040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.658183 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.658333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.658333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.659673 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.659846 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.660091 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.660261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.660505 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.660669 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.660825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.660976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.661135 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.661292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.661459 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.661622 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.661790 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.661965 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.662199 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.662354 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.662536 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.662696 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.662858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.663003 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.663147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.663298 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.663453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.663607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.663752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.663907 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.664063 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.664221 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.664366 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.664558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.664714 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.664858 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.665001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.665159 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.665350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.665508 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.665660 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.665805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.665956 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.666120 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.666266 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.666453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.666624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.666781 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.666943 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.667144 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.667291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.667434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.667585 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.667737 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.667901 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.668057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.668201 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.668353 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.668498 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.668650 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.668813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.668972 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.669299 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.669537 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.669880 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.670040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.670306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.670607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.670791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.670948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.671101 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.671257 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.671417 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.671570 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.671988 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.672140 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.672369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.672530 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.672676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.672821 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.672964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.673120 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.673278 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.673441 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.673593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.673746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.673896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.674049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.674851 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.675017 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.675172 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.675327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.675479 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.675623 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.675786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.676022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.676170 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.676314 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.676464 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.676616 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.676768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.676913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.677057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.677208 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.677370 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.677514 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.677677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.677829 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.677973 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.678115 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.678260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.678410 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.678593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.678740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.678884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.679036 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.679181 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.679499 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.679730 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.680110 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.680280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.680524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.680702 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.680944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.681098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.681098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.681434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.681434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.681715 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.681878 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.682040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.682185 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.682427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.682628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.682776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.682929 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.683081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.683225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.683377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.683523 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.683674 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.683902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.684058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.684209 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.684361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.684361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.684663 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.684663 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.684960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.685113 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.685275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.685275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.685578 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.685724 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.685867 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.686011 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.686153 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.686296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.686485 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.686651 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.686798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.686942 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.687085 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.687235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.687389 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.687534 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.687726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.687877 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.688028 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.688187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.688343 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.688494 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.688721 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.688892 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.689049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.689206 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.689356 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.689657 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.689929 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.690300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.690456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.690765 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.690933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.690933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.691338 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.691483 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.691636 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.691795 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.691951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.692096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.692248 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.692393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.692632 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.692784 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.692930 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.693075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.693230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.693230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.693531 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.693677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.693821 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.693964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.694108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.694252 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.694408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.694603 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.694769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.694916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.695061 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.695215 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.695369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.695530 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.695684 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.695836 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.695988 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.696143 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.696288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.696438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.696628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.696792 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.696944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.697119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.697287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.697473 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.697637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.697793 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.697950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.698116 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.698275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.698459 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.698631 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.698801 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.698954 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.699118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.699282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.699442 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.699736 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.699922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.700529 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.700708 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.700946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.701104 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.701361 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.701531 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.701694 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.701854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.702006 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.702168 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.702320 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.702524 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.703378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.703550 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.703718 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.703888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.704057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.704209 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.704614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.704778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.704957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.705110 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.705269 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.705937 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.706092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.706244 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.706408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.706408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.706746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.706746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.707032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.707032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.707340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.707494 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.707645 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.707804 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.707956 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.708120 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.708288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.708456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.708608 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.708768 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.708920 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.709079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.709239 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.709408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.709560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.709896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.710059 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.710323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.710735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.710897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.711180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.711371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.711630 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.711790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.711944 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.712095 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.712272 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.712433 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.712595 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.712775 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.713021 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.713179 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.713382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.713550 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.713703 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.713862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.714017 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.714169 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.714330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.714542 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.714714 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.714882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.715035 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.715340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.715496 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.715763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.715932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.716094 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.716256 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.716417 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.716571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.716958 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.717134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.717295 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.717447 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.717607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.717768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.717928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.718215 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.718354 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.718488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.718623 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.718754 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.718874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.718969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719141 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719227 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719318 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719498 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719761 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.719927 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.720026 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.720120 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.720207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.720461 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.720461 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.720864 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.721019 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.721608 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.721705 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722028 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722297 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722394 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722496 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722597 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722762 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722857 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.722949 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723203 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723536 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723633 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.723993 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724172 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724355 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724441 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724524 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724618 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724703 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724794 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724879 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.724962 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725141 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725234 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725479 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725562 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725829 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.725996 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726178 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726267 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726435 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726686 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726866 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.726958 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727125 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727309 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727401 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727485 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727576 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727661 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727752 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.727928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728020 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728104 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728194 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728194 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728546 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728787 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.728966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729140 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729226 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729623 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729792 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.729977 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.730113 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.730207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.730300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.730403 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.730594 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.730694 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.730781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731269 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731449 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731541 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731627 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731722 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.731925 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732437 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732540 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732812 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.732988 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733081 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733487 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733587 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733681 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733767 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.733943 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734123 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734215 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734307 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734392 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734872 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.734960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735135 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735220 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735461 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735556 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735650 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.735922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736014 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736192 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736473 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736585 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736682 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736768 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736859 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.736952 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737223 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737307 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737390 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737472 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737565 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737657 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737742 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737825 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.737915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738009 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738615 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.738991 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739114 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739209 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739389 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739472 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739556 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739639 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739730 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.739909 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740085 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740849 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.740942 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741226 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741594 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741696 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.741945 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.742065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.742202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.742406 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.742563 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.742700 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.742814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.742932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743051 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743171 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743284 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743751 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743751 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.743986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.744106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.744293 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.744418 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.744548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.744673 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.744793 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.744912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745035 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745375 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745536 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.745870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746005 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746147 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746238 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746331 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746417 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746551 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746750 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.746933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747152 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747680 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747775 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747862 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.747953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.748038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.748253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.748356 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.748560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.748653 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.748883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.748976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.749208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.749309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.749524 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.749624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.749853 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.749953 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.750184 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.750323 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.750543 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.750889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.751229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.751508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.751650 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.751938 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.752048 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.752255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.752353 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.752589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.752709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.752913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.753014 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.753243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.753340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.753554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.753658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.753866 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.753966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.754176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.754267 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.754512 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.754622 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.754823 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.754926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.755137 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.755243 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.755450 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.755541 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.755757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.755850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.756064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.756174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.756368 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.756469 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.756690 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.756791 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.756998 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.757098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.757323 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.757415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.757639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.757795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.757950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.758045 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.758260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.758354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.758590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.758687 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.758917 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.759020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.759230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.759322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.759538 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.759638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.759852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.759945 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.760159 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.760251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.760504 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.760604 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.760812 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.760971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.761136 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.761285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.761497 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.761607 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.761760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.761854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.762077 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.762180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.762396 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.762523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.762745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.762853 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.763064 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.763159 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.763379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.763486 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.763695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.763794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.763998 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.764089 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.764301 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.764414 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.764611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.764705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.764916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.765189 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.765293 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.765510 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.765609 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.765817 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.765910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.766121 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.766269 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.766424 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.766636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.766750 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.766845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.767071 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.767177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.767376 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.767477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.767698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.767799 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.768535 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.768638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.768843 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.768944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.769150 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.769243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.769454 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.769555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.769794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.769887 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.770098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.770191 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.770438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.770593 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.770776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.770871 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.771099 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.771203 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.771424 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.771570 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.771725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.771819 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.772050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.772164 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.772363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.772465 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.772708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.773033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.773124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.773355 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.773447 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.773673 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.773771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.773989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.774086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.774307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.774399 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.774656 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.774763 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.774970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.775071 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.775290 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.775390 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.775605 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.775698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.775922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.776026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.776264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.776477 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.776628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.776790 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.776937 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.777112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.777260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.777430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.777576 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.777746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.777905 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.778068 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.778347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.778520 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.778709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.778858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.779015 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.779165 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.779306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.779448 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.779619 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.779770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.779949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.780096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.780284 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.780473 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.780616 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.780775 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.780933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.781028 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.781219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.781371 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.781539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.781690 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.781844 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.781935 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.782153 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.782260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.782487 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.782598 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.782822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.782923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.783132 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.783225 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.783467 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.784082 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.784316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.784407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.784684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.784855 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.785003 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.785217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.785311 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.785537 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.785631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.785869 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.785975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.786199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.786300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.786556 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.786663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.786868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.786976 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.787184 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.787283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.787489 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.787588 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.787798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.787892 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.788115 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.788208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.788429 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.788531 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.788737 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.788946 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.789051 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.789128 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.789344 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.789560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.789714 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.789878 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.789972 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.790211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.790305 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.790563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.790692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.790891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.790993 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.791207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.791306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.791533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.791637 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.791817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.791927 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.792123 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.792215 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.792427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.792563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.792734 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.792825 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.793038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.793152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.793340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.793440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.793652 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.793752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.793959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.794064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.794261 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.794352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.794596 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.794720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.794919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.795045 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.795228 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.795464 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.795619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.795818 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.795971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.796128 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.796278 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.796439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.796575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.796987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.797094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.797300 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.797394 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.797615 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.797716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.797939 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.798047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.798246 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.798339 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.798577 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.798688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.798896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.799158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.799255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.799486 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.799580 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.799821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.800025 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.800200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.800368 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.800462 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.800693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.800813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.801025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.801129 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.801331 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.801487 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.801735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.801864 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.801970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.802063 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.802254 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.802368 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.802581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.802682 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.802895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.802990 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.803198 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.803310 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.803504 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.803618 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.803806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.803915 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.804111 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.804206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.804423 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.804524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.804728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.804828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.805037 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.805131 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.805342 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.805445 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.805652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.805753 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.805955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.806048 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.806264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.806366 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.806589 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.806688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.806912 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.807017 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.807218 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.807437 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.807591 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.807741 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.807884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.808038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.808193 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.808337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.808477 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.808625 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.808773 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.808925 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.809078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.809220 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.809392 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.809554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.809692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.809848 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.810111 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.810387 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.810548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.810750 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.810889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.811066 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.811218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.811390 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.811549 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.811688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.811845 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.812021 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.812116 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.812333 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.812466 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.812639 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.812746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.812965 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.813078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.813274 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.813393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.813590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.813707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.813902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.814154 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.814258 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.814502 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.814613 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.814831 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.814950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.815145 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.815278 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.815459 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.815594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.815772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.815913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.816085 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.816225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.816397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.816534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.816736 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.816831 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.817057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.817159 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.817373 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.817473 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.817689 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.817783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.818005 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.818098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.818317 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.818423 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.818654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.818750 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.818966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.819061 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.819291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.819398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.819605 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.819714 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.819922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.820016 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.820236 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.820343 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.820542 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.820634 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.820879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.820979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.821197 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.821304 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.821557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.821663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.821834 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.821938 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.822158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.822249 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.822490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.822596 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.822819 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.822914 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.823145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.823288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.823465 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.823559 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.823771 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.823870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.824081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.824176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.824389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.824490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.824704 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.824811 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.825022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.825114 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.825338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.825440 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.825653 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.825757 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.825967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.826060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.826279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.826379 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.826620 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.826729 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.826935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.827040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.827249 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.827342 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.827561 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.827674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.827871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.827966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.828190 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.828282 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.828498 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.828599 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.828819 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.828914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.829128 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.829220 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.829445 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.829541 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.829753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.829845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.830063 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.830165 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.830913 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.831029 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.831239 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.831341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.831554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.831673 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.831874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.831988 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.832205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.832309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.832522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.832665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.832845 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.832954 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.833156 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.833289 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.833477 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.833596 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.833800 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.833901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.834052 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:20:58.834144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.834416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.834754 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.835065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.835400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.835713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.836026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.836335 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.836647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.836960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.837268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.837647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.837924 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.838231 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.838576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.838895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.839211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.839526 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.839838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.840164 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.840474 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.840794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.841104 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.841413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.841727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.842043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.842383 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.842734 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.843057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.843396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.843725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.844036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.844391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.844718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:20:58.844961 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:20:58.858076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_db.sqlalchemy.engines [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:58.870206 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_db.sqlalchemy.engines [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:59.026559 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.context [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ff5b841-e3d6-4f57-b836-5edd3f142ad2(cell1) {{(pid=107332) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:20:59.030806 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:20:59.032386 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:20:59.033191 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:20:59.035731 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:20:59.038988 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.context [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ff5b841-e3d6-4f57-b836-5edd3f142ad2(cell1) {{(pid=107333) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 15:20:59.043193 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:20:59.044796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:20:59.046933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:20:59.047083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_db.sqlalchemy.engines [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:59.049634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:20:59.049727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_db.sqlalchemy.engines [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:59.058859 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_db.sqlalchemy.engines [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:59.059709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_db.sqlalchemy.engines [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:59.311554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_db.sqlalchemy.engines [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:59.325386 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_db.sqlalchemy.engines [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:20:59.644016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: WARNING keystonemiddleware.auth_token [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:20:59.650522 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: WARNING keystonemiddleware.auth_token [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:20:59.654732 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: WARNING keystonemiddleware.auth_token [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:20:59.661324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: WARNING keystonemiddleware.auth_token [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:20:59.996438 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: WARNING keystonemiddleware.auth_token [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:21:00.001638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: WARNING keystonemiddleware.auth_token [None req-ec4cb2d8-794b-4007-99bd-197bb406abae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:21:00.007055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4b2b019c0 pid: 107332 (default app) Jul 27 15:21:00.007166 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: WARNING keystonemiddleware.auth_token [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 15:21:00.012248 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: WARNING keystonemiddleware.auth_token [None req-c058c5ef-8c93-49ea-856d-2a44a7fbb6ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 15:21:00.017539 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4b2b019c0 pid: 107333 (default app) Jul 27 15:21:33.165180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7b637591-cebb-47b2-ab0e-4fae265ca420 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Action: 'create', calling method: .version_select at 0x7f33fd67c160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1358173748"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:33.296844 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8789d40f-74c3-47d1-8d36-473415a02ca3 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Action: 'create', calling method: .version_select at 0x7f33fd67d160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1238374511", "metadata": {"Type": "work"}}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:33.300390 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8789d40f-74c3-47d1-8d36-473415a02ca3 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:33.301754 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8789d40f-74c3-47d1-8d36-473415a02ca3 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.134087 Jul 27 15:21:33.303050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1156 bytes} [Tue Jul 27 15:21:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:21:33.315779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-06e1eacb-bf02-4603-8b50-d0cb5ba0b419 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Action: 'create', calling method: .version_select at 0x7f33fd67dd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1453665302", "metadata": {"Type": "work"}}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:33.318042 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-06e1eacb-bf02-4603-8b50-d0cb5ba0b419 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:33.319278 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-06e1eacb-bf02-4603-8b50-d0cb5ba0b419 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009186 Jul 27 15:21:33.321578 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 2/2] 10.222.0.37 () {60 vars in 1156 bytes} [Tue Jul 27 15:21:33 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:21:33.335912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-10f6811b-6769-4fba-8a71-2e2f1fb732c3 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Action: 'create', calling method: .version_select at 0x7f33fd67d940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-488900856", "metadata": {"Type": "work"}}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:33.339767 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-10f6811b-6769-4fba-8a71-2e2f1fb732c3 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:33.342142 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-10f6811b-6769-4fba-8a71-2e2f1fb732c3 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013770 Jul 27 15:21:33.347001 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 3/3] 10.222.0.37 () {60 vars in 1156 bytes} [Tue Jul 27 15:21:33 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 15:21:33.359999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f5689dff-cbc2-4f30-8713-27572286c99d tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Calling method '.version_select at 0x7f33fd67d4c0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:34.022173 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-f5689dff-cbc2-4f30-8713-27572286c99d tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] HTTP exception thrown: Volume tempest-invalid-1012906982 could not be found. Jul 27 15:21:34.023059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f5689dff-cbc2-4f30-8713-27572286c99d tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Returning 404 to user: Volume tempest-invalid-1012906982 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:34.024050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f5689dff-cbc2-4f30-8713-27572286c99d tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1012906982" status: 404 len: 99 microversion: 2.1 time: 0.671077 Jul 27 15:21:34.030783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 4/4] 10.222.0.37 () {58 vars in 1218 bytes} [Tue Jul 27 15:21:33 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1012906982 => generated 99 bytes in 673 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 27 15:21:34.128098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1274602709", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "2e4cba79-c08b-4f34-ae9d-1e7bbf658eb5"}]}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:34.307760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7b637591-cebb-47b2-ab0e-4fae265ca420 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.905447 Jul 27 15:21:34.315490 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 1/5] 10.222.0.37 () {60 vars in 1155 bytes} [Tue Jul 27 15:21:32 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1909 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 15:21:34.315490 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b601a51e-55b5-4035-9ef7-b617feb39e97 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004462 Jul 27 15:21:34.321306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 2/6] 10.222.0.37 () {58 vars in 1140 bytes} [Tue Jul 27 15:21:34 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 15:21:34.334653 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e95bad33-d52e-4f2a-be2f-87fc5fc53b2e tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fd4c7c10>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:34.358039 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.network.neutron [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] validate_networks() for [('2e4cba79-c08b-4f34-ae9d-1e7bbf658eb5', None, None, None)] {{(pid=107332) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:21:34.459105 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e95bad33-d52e-4f2a-be2f-87fc5fc53b2e tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63" status: 200 len: 345 microversion: 2.1 time: 0.135506 Jul 27 15:21:34.459763 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 3/7] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:21:34 2021] GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:34.464783 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-80ae2546-1ba9-4888-a04e-616412130f2e tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003584 Jul 27 15:21:34.465385 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 4/8] 10.222.0.37 () {58 vars in 1137 bytes} [Tue Jul 27 15:21:34 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 15:21:34.474089 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a7c94af4-4d3e-46a0-a5ce-5d88f39a8fd7 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Calling method '.version_select at 0x7f33fd4c7f70>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:34.531969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-a7c94af4-4d3e-46a0-a5ce-5d88f39a8fd7 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] HTTP exception thrown: Volume c9a38e03-c583-4920-b04c-1d230752452e could not be found. Jul 27 15:21:34.532816 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a7c94af4-4d3e-46a0-a5ce-5d88f39a8fd7 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Returning 404 to user: Volume c9a38e03-c583-4920-b04c-1d230752452e could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:34.533714 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a7c94af4-4d3e-46a0-a5ce-5d88f39a8fd7 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/c9a38e03-c583-4920-b04c-1d230752452e" status: 404 len: 109 microversion: 2.1 time: 0.063038 Jul 27 15:21:34.538445 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 5/9] 10.222.0.37 () {58 vars in 1248 bytes} [Tue Jul 27 15:21:34 2021] DELETE /compute/v2.1/os-volumes/c9a38e03-c583-4920-b04c-1d230752452e => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:21:34.543675 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e78de740-cdec-4ad9-8f1d-f3d1587a91f2 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Calling method '.version_select at 0x7f33fdeb0550>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:34.588324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-e78de740-cdec-4ad9-8f1d-f3d1587a91f2 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] HTTP exception thrown: Volume 16a6eee7-2e94-47c8-8317-3795f1443bac could not be found. Jul 27 15:21:34.588978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e78de740-cdec-4ad9-8f1d-f3d1587a91f2 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] Returning 404 to user: Volume 16a6eee7-2e94-47c8-8317-3795f1443bac could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:34.589815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e78de740-cdec-4ad9-8f1d-f3d1587a91f2 tempest-VolumesNegativeTest-1082675033 tempest-VolumesNegativeTest-1082675033-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/16a6eee7-2e94-47c8-8317-3795f1443bac" status: 404 len: 109 microversion: 2.1 time: 0.050097 Jul 27 15:21:34.590355 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 6/10] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:21:34 2021] GET /compute/v2.1/os-volumes/16a6eee7-2e94-47c8-8317-3795f1443bac => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:21:35.593791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-660314290", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "e7f2813b-6649-45a6-b769-67fc889c519f"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:35.712624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] validate_networks() for [('e7f2813b-6649-45a6-b769-67fc889c519f', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:21:35.817848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Flavor limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:21:35.819220 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Image limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:21:35.820349 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Flavor pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:21:35.820939 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Image pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:21:35.823861 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:21:35.877814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:35.879571 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:35.883947 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:35.888594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:36.009281 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Getting quotas for project 76744c59ed114d22a0d7f9027f318861. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:36.022855 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Getting quotas for user 223efd1a03274a90a7d913b761b2cbef and project 76744c59ed114d22a0d7f9027f318861. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:36.056571 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Going to run 1 instances... {{(pid=107332) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:21:36.065298 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:21:36.282127 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7e9cce0d-586a-4c00-a222-f43cbaf59205 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256397 Jul 27 15:21:36.283392 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 5/11] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:21:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 2258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:21:36.291903 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e3e23bb3-cc67-43cb-a6e1-68529f42d1db tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fd3d6430>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:36.430885 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e3e23bb3-cc67-43cb-a6e1-68529f42d1db tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63" status: 200 len: 346 microversion: 2.1 time: 0.144986 Jul 27 15:21:36.432253 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 6/12] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:21:36 2021] GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63 => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:36.437585 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c0c20d9a-7e81-4471-9cdf-0f03c7c5b520 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:36.438532 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c0c20d9a-7e81-4471-9cdf-0f03c7c5b520 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:36.635450 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c0c20d9a-7e81-4471-9cdf-0f03c7c5b520 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:36.660721 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c0c20d9a-7e81-4471-9cdf-0f03c7c5b520 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1215 microversion: 2.1 time: 0.227045 Jul 27 15:21:36.663687 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 7/13] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:36 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:36.668256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f7f81a07-8cbf-488d-a815-70c2a3df63dc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Action: 'create', calling method: .version_select at 0x7f33fcb84160>, body: {"snapshot": {"volume_id": "6400746e-4deb-4555-a270-71c40837de63", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-51523185"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:37.220199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f7f81a07-8cbf-488d-a815-70c2a3df63dc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.554987 Jul 27 15:21:37.226822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 8/14] 10.222.0.37 () {60 vars in 1162 bytes} [Tue Jul 27 15:21:36 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:37.238442 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fbe4bd8f-f33c-4996-9c0a-5b3ac0ae8e00 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb84ca0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:37.402735 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fbe4bd8f-f33c-4996-9c0a-5b3ac0ae8e00 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 200 len: 285 microversion: 2.1 time: 0.174439 Jul 27 15:21:37.408715 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 9/15] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:37 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:37.413640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f53e601e-be27-484b-a3f3-2032501ebbe1 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb9e160>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:37.492461 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f53e601e-be27-484b-a3f3-2032501ebbe1 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.082425 Jul 27 15:21:37.493195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 10/16] 10.222.0.37 () {58 vars in 1140 bytes} [Tue Jul 27 15:21:37 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:37.503400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e9d21236-a00b-480f-81db-e7ff225d78dc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcba2040>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:37.547630 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e9d21236-a00b-480f-81db-e7ff225d78dc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 200 len: 285 microversion: 2.1 time: 0.047767 Jul 27 15:21:37.552883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 11/17] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:37 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 285 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:37.681287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bab9b6ba-d77b-4006-b0de-330d3d4c0904 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:37.681907 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bab9b6ba-d77b-4006-b0de-330d3d4c0904 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:37.969647 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bab9b6ba-d77b-4006-b0de-330d3d4c0904 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:37.981829 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bab9b6ba-d77b-4006-b0de-330d3d4c0904 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1215 microversion: 2.1 time: 0.305237 Jul 27 15:21:37.991311 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 12/18] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:37 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:38.560079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0764652e-c431-4b06-8471-f1ad4159b9fc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb9e160>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:38.606208 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0764652e-c431-4b06-8471-f1ad4159b9fc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 200 len: 285 microversion: 2.1 time: 0.049961 Jul 27 15:21:38.607060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 13/19] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:38 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 285 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:38.613718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:21:38.614164 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:21:38.614651 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:21:38.615065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:21:38.615499 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:21:38.637148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:38.637601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:38.646375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:38.646941 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:38.716958 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:38.732205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for user 7b825ab5c9074d2891ef14d3ee406e03 and project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:38.781466 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:21:38.785296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:21:38.966852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4e59dd25-15b2-4382-a6cd-f3e3cde4158e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.501853 Jul 27 15:21:38.968203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 7/20] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:21:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 3514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:21:38.978181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ba9e4e92-7c44-4349-9e7b-a0c1283a9fed tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:38.979054 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ba9e4e92-7c44-4349-9e7b-a0c1283a9fed tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:38.998400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:38.999292 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:39.048649 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:39.049097 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:39.049886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:39.050322 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:39.273597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ba9e4e92-7c44-4349-9e7b-a0c1283a9fed tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:39.283668 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ba9e4e92-7c44-4349-9e7b-a0c1283a9fed tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1217 microversion: 2.1 time: 0.309335 Jul 27 15:21:39.297660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 14/21] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:38 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1217 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:39.492037 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:39.523646 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b1ac5b34-655c-48a6-b24e-e2478468362e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1219 microversion: 2.1 time: 0.528973 Jul 27 15:21:39.524340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 8/22] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:38 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1219 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:39.620366 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-061f9378-8bab-4ac0-8e45-ab8209885b9a tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb9eee0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:39.672576 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-061f9378-8bab-4ac0-8e45-ab8209885b9a tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 200 len: 285 microversion: 2.1 time: 0.056931 Jul 27 15:21:39.677768 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 15/23] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:39 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:40.312773 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cdaa9c1f-b7fe-4b84-a4ce-da922035b2f1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:40.313415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cdaa9c1f-b7fe-4b84-a4ce-da922035b2f1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:40.543444 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:40.548841 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cdaa9c1f-b7fe-4b84-a4ce-da922035b2f1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:40.551498 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:40.565616 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:40.566328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:40.567453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:40.568135 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:40.596765 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cdaa9c1f-b7fe-4b84-a4ce-da922035b2f1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1217 microversion: 2.1 time: 0.297158 Jul 27 15:21:40.597354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 9/24] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:40 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1217 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:40.684618 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2384f1af-f9da-4c6a-bf4e-33e493912665 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb21d30>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:40.737510 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2384f1af-f9da-4c6a-bf4e-33e493912665 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 200 len: 285 microversion: 2.1 time: 0.056891 Jul 27 15:21:40.741173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 10/25] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:40 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 285 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:21:40.873317 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:40.892314 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-aa56d030-de79-4c81-812d-e59455431dd1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1219 microversion: 2.1 time: 0.352200 Jul 27 15:21:40.904196 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 16/26] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:40 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1219 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:41.644797 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:41.659189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:41.679431 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:41.680095 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:41.681128 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:41.681727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:41.751510 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2b6285c3-551c-46ff-8ca7-38997d82e5aa tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb0fc10>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:41.828195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2b6285c3-551c-46ff-8ca7-38997d82e5aa tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 200 len: 286 microversion: 2.1 time: 0.081196 Jul 27 15:21:41.829646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 17/27] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:41 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:21:41.840716 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9b04029d-b6c6-4789-878b-a1df216a8bcc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb1a550>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:41.968770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:41.980434 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2427608c-806c-432d-abdd-ca0b19d5c0e4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1213 microversion: 2.1 time: 0.356262 Jul 27 15:21:41.982610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 11/28] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:41 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1213 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:42.009979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:42.010655 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:42.031427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:42.033200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:42.039977 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:42.040923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:42.049728 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9b04029d-b6c6-4789-878b-a1df216a8bcc tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 202 len: 0 microversion: 2.1 time: 0.213168 Jul 27 15:21:42.051030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 18/29] 10.222.0.37 () {58 vars in 1254 bytes} [Tue Jul 27 15:21:41 2021] DELETE /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:21:42.060507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b5e56ea6-8343-4e16-a9ab-2f570c084032 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcba25e0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:42.148142 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b5e56ea6-8343-4e16-a9ab-2f570c084032 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 200 len: 285 microversion: 2.1 time: 0.092914 Jul 27 15:21:42.149184 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 19/30] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:42 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:21:42.291954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:42.303987 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b24d198b-257b-4c5d-99d0-9d4cffdc3d23 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1275 microversion: 2.1 time: 0.317263 Jul 27 15:21:42.307204 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 12/31] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:41 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:42.998842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:42.999471 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:43.016236 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:43.017240 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:43.018042 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:43.018539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:43.160955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4616ef52-560c-403e-a1ef-70c38a40c9f9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb21d30>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:43.231683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-4616ef52-560c-403e-a1ef-70c38a40c9f9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] HTTP exception thrown: Snapshot aae0ef34-5a24-4aec-b950-05e6f1eca0ff could not be found. Jul 27 15:21:43.232307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4616ef52-560c-403e-a1ef-70c38a40c9f9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Returning 404 to user: Snapshot aae0ef34-5a24-4aec-b950-05e6f1eca0ff could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:43.233272 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4616ef52-560c-403e-a1ef-70c38a40c9f9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff" status: 404 len: 111 microversion: 2.1 time: 0.076856 Jul 27 15:21:43.234033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 13/32] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:21:43 2021] GET /compute/v2.1/os-snapshots/aae0ef34-5a24-4aec-b950-05e6f1eca0ff => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:21:43.247801 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a654696a-4256-4f00-bd52-900de6276623 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fd4e2160>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:43.361478 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a654696a-4256-4f00-bd52-900de6276623 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63" status: 202 len: 0 microversion: 2.1 time: 0.122463 Jul 27 15:21:43.362442 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 14/33] 10.222.0.37 () {58 vars in 1248 bytes} [Tue Jul 27 15:21:43 2021] DELETE /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:21:43.368065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:43.369431 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:43.379842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:43.380690 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:43.382451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:43.383835 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:43.392303 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0c4653b5-9650-4d2f-bf28-3c41ace311b2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1275 microversion: 2.1 time: 0.396438 Jul 27 15:21:43.398753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:43.400150 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 20/34] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:42 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1275 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:43.413425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c267f887-72bc-4594-b955-98c05e99c51a tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb1a160>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:43.644418 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c267f887-72bc-4594-b955-98c05e99c51a tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63" status: 200 len: 345 microversion: 2.1 time: 0.242933 Jul 27 15:21:43.645004 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 21/35] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:21:43 2021] GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63 => generated 345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:21:43.769768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:43.782214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9921dca0-d96c-4baa-8249-7043e0274b71 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1273 microversion: 2.1 time: 0.417317 Jul 27 15:21:43.792067 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 15/36] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:43 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1273 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:44.434832 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:44.436911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:44.450437 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:44.451057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:44.451848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:44.452334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:44.660305 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1f74ea91-889e-44b5-8d00-022186cc1da9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb349d0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:44.724225 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-1f74ea91-889e-44b5-8d00-022186cc1da9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] HTTP exception thrown: Volume 6400746e-4deb-4555-a270-71c40837de63 could not be found. Jul 27 15:21:44.724852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1f74ea91-889e-44b5-8d00-022186cc1da9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Returning 404 to user: Volume 6400746e-4deb-4555-a270-71c40837de63 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:44.725693 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1f74ea91-889e-44b5-8d00-022186cc1da9 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63" status: 404 len: 109 microversion: 2.1 time: 0.071864 Jul 27 15:21:44.726591 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 16/37] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:21:44 2021] GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:21:44.756720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1f92cf89-db11-4f2d-807e-1c13e70e46ac tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb6ed30>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:44.771623 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:44.791016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4e938a46-1957-493b-ba29-73080f22120e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1275 microversion: 2.1 time: 0.376740 Jul 27 15:21:44.792085 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 22/38] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:44 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1275 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:44.813824 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:44.819625 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:44.848505 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:44.849944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:44.851609 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-1f92cf89-db11-4f2d-807e-1c13e70e46ac tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] HTTP exception thrown: Volume 6400746e-4deb-4555-a270-71c40837de63 could not be found. Jul 27 15:21:44.852538 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1f92cf89-db11-4f2d-807e-1c13e70e46ac tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Returning 404 to user: Volume 6400746e-4deb-4555-a270-71c40837de63 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:44.853624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1f92cf89-db11-4f2d-807e-1c13e70e46ac tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63" status: 404 len: 109 microversion: 2.1 time: 0.110919 Jul 27 15:21:44.853760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:44.854608 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 17/39] 10.222.0.37 () {58 vars in 1248 bytes} [Tue Jul 27 15:21:44 2021] DELETE /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:21:44.854880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:44.866350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6d3d1998-5447-4b50-b66c-5d0135c65d09 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Calling method '.version_select at 0x7f33fcb13160>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:44.972401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-6d3d1998-5447-4b50-b66c-5d0135c65d09 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] HTTP exception thrown: Volume 6400746e-4deb-4555-a270-71c40837de63 could not be found. Jul 27 15:21:44.973846 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6d3d1998-5447-4b50-b66c-5d0135c65d09 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] Returning 404 to user: Volume 6400746e-4deb-4555-a270-71c40837de63 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:21:44.974937 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6d3d1998-5447-4b50-b66c-5d0135c65d09 tempest-VolumesSnapshotsTestJSON-1326254787 tempest-VolumesSnapshotsTestJSON-1326254787-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63" status: 404 len: 109 microversion: 2.1 time: 0.115941 Jul 27 15:21:44.975686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 18/40] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:21:44 2021] GET /compute/v2.1/os-volumes/6400746e-4deb-4555-a270-71c40837de63 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:21:45.183946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:45.208923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bf125b23-5a71-472c-92f4-fd3c76d982ea tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1273 microversion: 2.1 time: 0.398024 Jul 27 15:21:45.210425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 23/41] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:44 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1273 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:45.809792 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:45.811336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:45.839398 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:45.840086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:45.841453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:45.842192 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:45.981428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:45.993436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-eccd187e-61fa-4f21-a343-25ff2806577e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1275 microversion: 2.1 time: 0.186440 Jul 27 15:21:45.996526 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 19/42] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:45 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:46.227816 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:46.229689 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:46.239243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:46.239730 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:46.240864 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:46.241316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:46.395046 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:46.403918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-013d645d-f0f9-4939-b202-ba57a70627cc tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1273 microversion: 2.1 time: 0.180578 Jul 27 15:21:46.410215 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 24/43] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:46 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:46.959744 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bebe09a2-9ab8-4e0c-a0fc-65e119b20111 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'create', calling method: .version_select at 0x7f33fcb13160>, body: {"keypair": {"name": "tempest-keypair-1042919463"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:47.012225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:47.012852 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:47.023518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:47.024232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:47.025299 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:47.025895 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:47.093702 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-bebe09a2-9ab8-4e0c-a0fc-65e119b20111 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:47.118590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-bebe09a2-9ab8-4e0c-a0fc-65e119b20111 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for user 02755482dd304f38a78fca1f4a199577 and project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:47.312816 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:47.336856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-942a78d4-6f9a-4203-986f-14ba83053a58 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1275 microversion: 2.1 time: 0.323026 Jul 27 15:21:47.351795 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 25/44] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:47 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:47.426828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:47.427852 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:47.456404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:47.457291 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:47.458127 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:47.461982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:47.614771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:47.626769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fdc3d992-6df1-419d-b817-b58e0ec482cb tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1273 microversion: 2.1 time: 0.205301 Jul 27 15:21:47.635970 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 26/45] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:47 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:47.765781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-bebe09a2-9ab8-4e0c-a0fc-65e119b20111 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:47.777878 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-bebe09a2-9ab8-4e0c-a0fc-65e119b20111 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for user 02755482dd304f38a78fca1f4a199577 and project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:47.813108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bebe09a2-9ab8-4e0c-a0fc-65e119b20111 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.194430 Jul 27 15:21:47.815553 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 20/46] 10.222.0.37 () {60 vars in 1158 bytes} [Tue Jul 27 15:21:46 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:48.357532 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:48.358406 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:48.368897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:48.369809 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:48.372471 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:48.378297 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:48.524501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:48.550032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7284371f-ff0f-4e35-bb57-48f1b5bdcb88 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1275 microversion: 2.1 time: 0.183465 Jul 27 15:21:48.569827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 27/47] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:48 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1275 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:48.652385 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:48.653681 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:48.668495 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:48.669161 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:48.670106 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:48.670718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:48.919680 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:48.931111 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bdab4cf3-e004-4258-b1e1-e01e5d9fdc03 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1273 microversion: 2.1 time: 0.282449 Jul 27 15:21:48.944687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 21/48] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:48 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:49.572427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:49.573089 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:49.587463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:49.587947 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:49.588866 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:49.589348 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:49.804133 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:49.822399 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ef3042a4-dc92-4974-b81d-707aebd27d04 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1275 microversion: 2.1 time: 0.253228 Jul 27 15:21:49.829116 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 28/49] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:49 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:49.951737 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:49.953264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:49.968229 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:49.970346 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:49.974368 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:49.977919 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:50.627147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:50.637989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-55354c27-0250-46a6-806a-90197dd72b6a tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1273 microversion: 2.1 time: 0.689776 Jul 27 15:21:50.643992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 22/50] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:49 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1273 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:50.845282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:50.846501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:50.861259 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:50.863302 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:50.867310 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:50.872187 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:51.656289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:51.656998 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:51.668833 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:51.669349 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:51.672846 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:51.680126 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:52.117798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:52.130093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7639c03a-4dda-4321-8f9e-f2df7c5422e6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 1.285211 Jul 27 15:21:52.142446 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 29/51] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:50 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:52.753026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:52.780966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f8985248-1269-44a1-814d-c5d091459c72 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 1.111346 Jul 27 15:21:52.784695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 23/52] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:51 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:52.922621 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-761382436", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d13b796e-a783-460d-844e-a07d23cb040b"}]}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:53.046503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.network.neutron [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] validate_networks() for [('d13b796e-a783-460d-844e-a07d23cb040b', None, None, None)] {{(pid=107332) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:21:53.153089 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:53.153986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:53.166366 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:53.167258 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:53.168717 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:53.171366 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:54.369285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:54.388865 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e3e301e1-06d3-432d-951d-a44558ecf58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 1.242931 Jul 27 15:21:54.401460 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 24/53] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:53 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:54.428932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:54.429876 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:54.448877 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:54.456571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:54.457733 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:54.459890 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:55.060374 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:55.072787 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9611ef72-44cb-4ead-ac12-59267d69c5ef tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.669850 Jul 27 15:21:55.073979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 25/54] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:54 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:55.408570 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:55.409922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:55.412912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Flavor limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:21:55.413420 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Image limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:21:55.414067 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Flavor pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:21:55.414672 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Image pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:21:55.416043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:21:55.421359 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:55.425122 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:55.428112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:55.428782 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:55.450770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:55.451511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:55.457446 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:55.461230 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:55.556908 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Getting quotas for project 8aa9a0a21019483cbc4b4f3328f558d7. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:55.581149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Getting quotas for user d24962f23bed4f9dba749445f1e250fa and project 8aa9a0a21019483cbc4b4f3328f558d7. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:55.651374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Going to run 1 instances... {{(pid=107332) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:21:55.654246 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:21:55.926161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5ba5a4f8-3ad4-4c56-a628-d1a0cea5e842 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.781046 Jul 27 15:21:55.928957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 30/55] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:21:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 3785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:21:55.942689 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8c08247c-d5f8-4a39-9aa3-4004551e2286 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:55.946162 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8c08247c-d5f8-4a39-9aa3-4004551e2286 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:56.013918 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:56.043106 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-97c9eb4d-ed5a-498e-a8bf-28f16a7fced4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.637947 Jul 27 15:21:56.061898 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 26/56] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:55 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:56.081794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1755394075", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04c96614-87e6-4ab8-bd19-a70b3ad0e7be"}], "security_groups": [{"name": "tempest-securitygroup--1690379990"}], "key_name": "tempest-keypair-1042919463", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:56.181213 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8c08247c-d5f8-4a39-9aa3-4004551e2286 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:56.192444 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8c08247c-d5f8-4a39-9aa3-4004551e2286 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1221 microversion: 2.1 time: 0.257732 Jul 27 15:21:56.195317 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 31/57] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:55 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1221 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:21:56.205484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:56.207507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:56.221070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:56.221512 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:56.235882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:56.239274 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:56.880761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] validate_networks() for [('04c96614-87e6-4ab8-bd19-a70b3ad0e7be', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:21:57.118016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:57.129640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2758b9cb-6b2a-4002-a117-d57290c6ade8 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.933045 Jul 27 15:21:57.133509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 32/58] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:56 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:57.140914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-116991607", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d13b796e-a783-460d-844e-a07d23cb040b"}]}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:57.284994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.network.neutron [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] validate_networks() for [('d13b796e-a783-460d-844e-a07d23cb040b', None, None, None)] {{(pid=107332) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:21:58.081013 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:21:58.081961 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:21:58.082444 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:21:58.082875 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:21:58.083507 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:21:58.104501 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:58.104954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:58.106811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:58.109130 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:58.173415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for project 601e48ce650f46378322af9bcc36686a. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:58.178533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for user 02755482dd304f38a78fca1f4a199577 and project 601e48ce650f46378322af9bcc36686a. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:58.215225 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:21:58.229004 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:21:58.345817 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c27385c1-9859-4cd1-a396-609c8a5ad7d3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.276576 Jul 27 15:21:58.348906 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 27/59] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:21:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:21:58.355871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:58.356643 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:58.363641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:58.364266 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:58.365952 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:58.366638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:58.746072 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Flavor limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:21:58.746723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Image limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:21:58.746971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Flavor pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:21:58.747574 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Image pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:21:58.749678 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:21:58.767748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:58.770377 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:58.773208 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:58.775161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:58.836978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:58.851139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Getting quotas for project 8aa9a0a21019483cbc4b4f3328f558d7. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:58.857064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e15d8c60-71b4-4953-b181-1a7cc5995329 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.503227 Jul 27 15:21:58.861312 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 28/60] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:58 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:58.875983 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Getting quotas for user d24962f23bed4f9dba749445f1e250fa and project 8aa9a0a21019483cbc4b4f3328f558d7. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:58.916765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Going to run 1 instances... {{(pid=107332) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:21:58.918900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:21:58.993445 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d8b15bb7-dcea-4091-a8cb-2aa1c5f7a559 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'create', calling method: .version_select at 0x7f33fcb34af0>, body: {"keypair": {"name": "tempest-keypair-226043852"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:59.027036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-d8b15bb7-dcea-4091-a8cb-2aa1c5f7a559 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:59.034865 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-d8b15bb7-dcea-4091-a8cb-2aa1c5f7a559 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for user d7b9cd998ab149299ffa176bc898c6b2 and project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:59.043452 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-509fd9f6-dfa0-4f0d-adac-9bf8a15b5749 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.906530 Jul 27 15:21:59.044399 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 33/61] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:21:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:21:59.064340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:59.065997 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:59.100378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:59.101165 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:59.118707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:59.119821 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:59.405862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:59.416001 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-07081067-88c1-40ef-b42e-fe8433ed1e2f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.370390 Jul 27 15:21:59.417607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 34/62] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:59 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:59.604806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-d8b15bb7-dcea-4091-a8cb-2aa1c5f7a559 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:21:59.611705 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-d8b15bb7-dcea-4091-a8cb-2aa1c5f7a559 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for user d7b9cd998ab149299ffa176bc898c6b2 and project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:21:59.634645 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d8b15bb7-dcea-4091-a8cb-2aa1c5f7a559 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.771578 Jul 27 15:21:59.643796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 29/63] 10.222.0.37 () {62 vars in 1199 bytes} [Tue Jul 27 15:21:58 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 781 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 27 15:21:59.649284 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:59.649918 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:59.659584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:59.660035 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:59.661048 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:59.661683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:59.784278 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:59.796773 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b7d8d5c3-5f64-4852-8675-870b80045149 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1234 microversion: 2.1 time: 0.149452 Jul 27 15:21:59.807743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 30/64] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:59 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1234 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:59.818103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e8315ba3-7153-45c5-b395-ef85ab274f44 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:59.819680 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e8315ba3-7153-45c5-b395-ef85ab274f44 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:59.873489 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-b170bf1e-30ee-4348-be1f-e2235225bde8 req-18cab954-6a79-4a94-919d-e8a3c0d8d276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c2bf55-7c6b-4a6d-9135-1458daaf0613", "tag": "3b8cf6f8-2019-4de8-94cc-e634d7a1039f"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:21:59.881371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:59.881371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:21:59.928213 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-b170bf1e-30ee-4348-be1f-e2235225bde8 req-18cab954-6a79-4a94-919d-e8a3c0d8d276 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:59.930571 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-b170bf1e-30ee-4348-be1f-e2235225bde8 req-18cab954-6a79-4a94-919d-e8a3c0d8d276 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:59.947722 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e8315ba3-7153-45c5-b395-ef85ab274f44 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:21:59.959397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e8315ba3-7153-45c5-b395-ef85ab274f44 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1221 microversion: 2.1 time: 0.148397 Jul 27 15:21:59.961200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 31/65] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:59 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:21:59.985272 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:21:59.986628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-b170bf1e-30ee-4348-be1f-e2235225bde8 req-18cab954-6a79-4a94-919d-e8a3c0d8d276 service nova] Creating event network-changed:3b8cf6f8-2019-4de8-94cc-e634d7a1039f for instance 83c2bf55-7c6b-4a6d-9135-1458daaf0613 on hv-cinder-80043 Jul 27 15:21:59.987919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-b170bf1e-30ee-4348-be1f-e2235225bde8 req-18cab954-6a79-4a94-919d-e8a3c0d8d276 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 27 15:21:59.989026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:21:59.989933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27bff9f0-8dd5-494d-b0b7-ade0c0b48514 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:59.990585 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27bff9f0-8dd5-494d-b0b7-ade0c0b48514 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:21:59.992202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27bff9f0-8dd5-494d-b0b7-ade0c0b48514 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:21:59.997451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27bff9f0-8dd5-494d-b0b7-ade0c0b48514 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.008719 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.009324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.011847 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.compute.rpcapi [None req-27bff9f0-8dd5-494d-b0b7-ade0c0b48514 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 27 15:22:00.013434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27bff9f0-8dd5-494d-b0b7-ade0c0b48514 None None] Releasing lock "compute-rpcapi-router" {{(pid=107332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 27 15:22:00.026853 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.027544 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.083283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-27bff9f0-8dd5-494d-b0b7-ade0c0b48514 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.662733 Jul 27 15:22:00.084270 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 35/66] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:21:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:00.437242 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:00.437616 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:00.439005 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:00.451697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-adccd5e3-80be-4380-a097-a9777d624369 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.474809 Jul 27 15:22:00.453020 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 32/67] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:21:59 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:00.470727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.471155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.472004 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.472455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.815189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:00.815814 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:00.833562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.834277 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.838753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.845603 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.864201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:00.872118 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-397e43fd-c287-4ee2-95c2-cbfa9daf6707 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.440590 Jul 27 15:22:00.877356 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 36/68] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:00 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:00.978816 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:00.979477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:00.989423 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.989880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:00.992902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:00.993503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:01.071785 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:01.088216 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-047068b6-b962-42a5-a75f-c0be6e4c77a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1296 microversion: 2.1 time: 0.272856 Jul 27 15:22:01.089885 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 33/69] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:00 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1296 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:01.212327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:01.225888 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1a5ea971-1e57-45d5-bfe6-a90d4649bb61 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1273 microversion: 2.1 time: 0.251298 Jul 27 15:22:01.227608 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 37/70] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:00 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:01.470343 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:01.471047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:01.479400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:01.483270 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:01.486701 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:01.487525 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:01.893674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:01.894903 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:01.912245 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:01.912518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:01.913311 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:01.913748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.067817 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:02.075912 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-39942be0-3d3a-405d-9ce7-4e8c60c72bcc tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.610388 Jul 27 15:22:02.076796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 34/71] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:01 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:02.106046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:02.108508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:02.121053 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:02.121824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.122867 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:02.123496 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.220184 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:02.232897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ea1122b2-12bb-4e56-9472-f84205fa0d4c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.342779 Jul 27 15:22:02.235239 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 38/72] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:01 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:02.250025 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:02.252492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:02.262559 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:02.269483 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:02.270585 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.271353 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-549ec419-0e27-41d1-82f9-8243864ce8fe tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1296 microversion: 2.1 time: 0.168806 Jul 27 15:22:02.274515 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:02.274641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 35/73] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:02 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:02.275685 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.312205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-a03583ca-a188-4369-9fad-b9e044e07ebb req-56babfff-1a6b-45e2-b77a-51af7119db27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929e4f85-7f61-48f5-baed-a47e4becf407", "tag": "ea60ffff-301e-4030-bf10-27f57eb5b6cd"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:02.317764 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:02.317764 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:22:02.340087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-a03583ca-a188-4369-9fad-b9e044e07ebb req-56babfff-1a6b-45e2-b77a-51af7119db27 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:02.343395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-a03583ca-a188-4369-9fad-b9e044e07ebb req-56babfff-1a6b-45e2-b77a-51af7119db27 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.403281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-a03583ca-a188-4369-9fad-b9e044e07ebb req-56babfff-1a6b-45e2-b77a-51af7119db27 service nova] Creating event network-changed:ea60ffff-301e-4030-bf10-27f57eb5b6cd for instance 929e4f85-7f61-48f5-baed-a47e4becf407 on hv-cinder-80043 Jul 27 15:22:02.410747 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-a03583ca-a188-4369-9fad-b9e044e07ebb req-56babfff-1a6b-45e2-b77a-51af7119db27 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 27 15:22:02.412174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1dc0f570-018b-4637-b207-e1314627de47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:02.412725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1dc0f570-018b-4637-b207-e1314627de47 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.413572 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1dc0f570-018b-4637-b207-e1314627de47 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:02.414050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1dc0f570-018b-4637-b207-e1314627de47 None None] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:02.434145 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.compute.rpcapi [None req-1dc0f570-018b-4637-b207-e1314627de47 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 27 15:22:02.435778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1dc0f570-018b-4637-b207-e1314627de47 None None] Releasing lock "compute-rpcapi-router" {{(pid=107333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 27 15:22:02.485949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1dc0f570-018b-4637-b207-e1314627de47 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181758 Jul 27 15:22:02.485949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 36/74] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:02.491283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:02.502395 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-51e3a7c0-a16e-4351-aad7-bcae6cea85df tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1279 microversion: 2.1 time: 0.261400 Jul 27 15:22:02.515087 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 39/75] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:02 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:03.095006 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:03.095557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:03.103707 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:03.104518 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:03.105449 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:03.107489 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:03.251757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:03.252996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:03.262439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:03.267167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:03.268103 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:03.268603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:04.296708 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:04.307525 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-47ebab64-c9a3-4c62-9350-580a4bf0e0c3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 1.218016 Jul 27 15:22:04.321227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 37/76] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:03 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:04.327592 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:04.329820 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:04.347455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:04.348860 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:04.350908 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:04.352549 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:04.364108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:04.376553 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cd545164-7e85-488f-8834-a6a2b7ecd860 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 1.129344 Jul 27 15:22:04.377173 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 40/77] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:03 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:04.384263 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:04.384879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:04.401526 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:04.401991 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:04.415125 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:04.415778 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:05.166675 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:05.176047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:05.195662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5f33bd2a-8012-479b-8ed3-33d2da554d01 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.871588 Jul 27 15:22:05.197830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-377b886a-08b1-4db1-ac81-3ea9a1584786 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.815506 Jul 27 15:22:05.198760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 41/78] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:04 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:05.201130 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 38/79] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:04 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:05.224059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-8edeea76-65e6-4390-aa84-f5dace811293 req-8d87d894-e5a1-4e7e-98d3-d32d94f2df8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8430fe02-1ac5-4a7b-9332-d299c54fa8b2", "tag": "c19d7c85-39cc-4b88-9f66-88f0b1054f65"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:05.227093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:05.227093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:05.238736 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-8edeea76-65e6-4390-aa84-f5dace811293 req-8d87d894-e5a1-4e7e-98d3-d32d94f2df8e service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:05.239557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-8edeea76-65e6-4390-aa84-f5dace811293 req-8d87d894-e5a1-4e7e-98d3-d32d94f2df8e service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:05.261418 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-8edeea76-65e6-4390-aa84-f5dace811293 req-8d87d894-e5a1-4e7e-98d3-d32d94f2df8e service nova] Creating event network-changed:c19d7c85-39cc-4b88-9f66-88f0b1054f65 for instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 on hv-cinder-80043 Jul 27 15:22:05.270775 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-8edeea76-65e6-4390-aa84-f5dace811293 req-8d87d894-e5a1-4e7e-98d3-d32d94f2df8e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069806 Jul 27 15:22:05.271683 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 42/80] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:05.325245 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:05.325876 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:05.332147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:05.332597 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:05.333378 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:05.333811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:05.394740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:05.395970 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:05.403091 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:05.403855 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:05.404826 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:05.405409 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:05.832276 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:05.844933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a285ce4e-2fd6-416d-9579-c01f18f5be63 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.523210 Jul 27 15:22:05.846207 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 39/81] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:05 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:05.879840 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:05.892203 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a4b2c0e1-c6e6-4c7a-ab6c-c24ae6fa3c97 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.501951 Jul 27 15:22:05.899698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 43/82] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:05 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:05.960730 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-35cfa08c-786d-4a56-826b-ce6df8fe346a req-caa57763-77ab-4236-b627-9e49b4fd2e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b978b7b-a76a-4c2b-94d7-ecdd064ddad3", "tag": "e6af182d-e796-4b48-bce1-9f47262a90dc"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:05.962577 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:05.962577 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:22:05.971354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-35cfa08c-786d-4a56-826b-ce6df8fe346a req-caa57763-77ab-4236-b627-9e49b4fd2e63 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:05.971794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-35cfa08c-786d-4a56-826b-ce6df8fe346a req-caa57763-77ab-4236-b627-9e49b4fd2e63 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:06.002069 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-35cfa08c-786d-4a56-826b-ce6df8fe346a req-caa57763-77ab-4236-b627-9e49b4fd2e63 service nova] Creating event network-changed:e6af182d-e796-4b48-bce1-9f47262a90dc for instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 on hv-cinder-80043 Jul 27 15:22:06.028870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-35cfa08c-786d-4a56-826b-ce6df8fe346a req-caa57763-77ab-4236-b627-9e49b4fd2e63 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181127 Jul 27 15:22:06.029469 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 40/83] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:06.218635 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:06.219176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:06.220081 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:06.221025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:06.234202 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:06.241295 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:06.241985 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:06.243057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:06.243869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:06.244554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:06.245578 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:06.246057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:06.927601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:06.932510 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:06.935372 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-be49660c-f9eb-42c3-8cf4-e1bc1cb00435 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.720969 Jul 27 15:22:06.935939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 41/84] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:06 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:06.940888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-960709983", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e16a608d-1d8f-4d39-a295-bd2fefb7b802"}], "security_groups": [{"name": "tempest-securitygroup--1379749242"}], "key_name": "tempest-keypair-226043852", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:06.949504 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-716ce878-3c6e-4a54-8716-275c8e573362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.740440 Jul 27 15:22:06.950217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 44/85] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:06 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:06.955384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:06.956241 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:06.963944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:06.964463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:06.965311 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:06.966016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.097744 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] validate_networks() for [('e16a608d-1d8f-4d39-a295-bd2fefb7b802', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:22:07.294824 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:07.302368 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-511ca0fc-7a50-4192-a382-978de32fbb32 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.351071 Jul 27 15:22:07.303128 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 45/86] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:06 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:07.307516 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:07.308121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:07.314889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:07.315336 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.316109 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:07.316542 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.682561 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:07.693838 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c119080b-916b-454b-8f81-143e83ed322c tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.389052 Jul 27 15:22:07.695016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 46/87] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:07 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:07.702605 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-d8e46195-3f2b-48f7-b42c-7f5640f15793 req-261f2599-bfde-4311-b01a-5e917b2d1c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a264be-9867-41ed-8a97-19899b508639", "tag": "2f28d58b-d9e8-4f6b-84d0-a16d154fe9ba"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:07.705138 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:07.705138 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:07.722395 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-d8e46195-3f2b-48f7-b42c-7f5640f15793 req-261f2599-bfde-4311-b01a-5e917b2d1c6a service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:07.723566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-d8e46195-3f2b-48f7-b42c-7f5640f15793 req-261f2599-bfde-4311-b01a-5e917b2d1c6a service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.741313 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-d8e46195-3f2b-48f7-b42c-7f5640f15793 req-261f2599-bfde-4311-b01a-5e917b2d1c6a service nova] Creating event network-changed:2f28d58b-d9e8-4f6b-84d0-a16d154fe9ba for instance 49a264be-9867-41ed-8a97-19899b508639 on hv-cinder-80043 Jul 27 15:22:07.748022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-d8e46195-3f2b-48f7-b42c-7f5640f15793 req-261f2599-bfde-4311-b01a-5e917b2d1c6a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051316 Jul 27 15:22:07.749272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 47/88] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:07.907283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:22:07.908044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:22:07.908975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:22:07.909386 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:22:07.909791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:22:07.926631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:07.927601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.928644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:07.930191 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.951755 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for project 65683f78756f4210b7c18932064a8ecf. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:22:07.957664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:07.959697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:07.968316 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for user d7b9cd998ab149299ffa176bc898c6b2 and project 65683f78756f4210b7c18932064a8ecf. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:22:07.970070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:07.970773 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.971798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:07.972414 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:07.994213 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:22:08.005925 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:22:08.095283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a4e400ae-d12b-4df5-a1fb-f52e41450cdd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.158096 Jul 27 15:22:08.099070 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 42/89] 10.222.0.37 () {62 vars in 1188 bytes} [Tue Jul 27 15:22:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 15:22:08.116870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.117550 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:08.125995 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:08.126719 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:08.127683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:08.128379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:08.369012 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:08.376850 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-caec75f9-b007-4112-9fda-bd8cb60a15ff tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.428478 Jul 27 15:22:08.377430 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 48/90] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:07 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:08.401760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-980a307e-6770-47d8-85c1-94c2c264ed08 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.403406 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-980a307e-6770-47d8-85c1-94c2c264ed08 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:08.491882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-980a307e-6770-47d8-85c1-94c2c264ed08 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:08.501493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-980a307e-6770-47d8-85c1-94c2c264ed08 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:08.503054 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-980a307e-6770-47d8-85c1-94c2c264ed08 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:08.504400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-980a307e-6770-47d8-85c1-94c2c264ed08 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1280 microversion: 2.20 time: 0.121793 Jul 27 15:22:08.505008 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 49/91] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:08 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:08.514957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.514957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:08.517514 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:08.517973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:08.518987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:08.519568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:08.588046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:08.601019 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-46ae8d64-1d1e-44b0-a998-befa37cb33e2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.492354 Jul 27 15:22:08.601858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 43/92] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:08 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:08.711501 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:08.712686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:08.725388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:08.725858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:08.727031 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:08.727504 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:08.785928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:08.793506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5cd9935b-74e2-4f3d-8d6b-d96428e57cbf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.287382 Jul 27 15:22:08.796172 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 50/93] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:08 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:09.016042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:09.028810 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5bd09a00-7570-48c7-a251-b3438369dc7d tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.322598 Jul 27 15:22:09.029722 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 44/94] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:08 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:09.382002 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-5acd0a85-e940-459d-98ac-cd6275f93011 req-44b84aef-1006-408d-9c31-22056cf62be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929e4f85-7f61-48f5-baed-a47e4becf407", "name": "network-vif-plugged", "status": "completed", "tag": "ea60ffff-301e-4030-bf10-27f57eb5b6cd"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:09.383598 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:09.383598 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:09.393790 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:09.394702 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:09.402157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.405022 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.405850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.407566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-5acd0a85-e940-459d-98ac-cd6275f93011 req-44b84aef-1006-408d-9c31-22056cf62be1 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.408223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-5acd0a85-e940-459d-98ac-cd6275f93011 req-44b84aef-1006-408d-9c31-22056cf62be1 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.408553 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.430878 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-5acd0a85-e940-459d-98ac-cd6275f93011 req-44b84aef-1006-408d-9c31-22056cf62be1 service nova] Creating event network-vif-plugged:ea60ffff-301e-4030-bf10-27f57eb5b6cd for instance 929e4f85-7f61-48f5-baed-a47e4becf407 on hv-cinder-80043 Jul 27 15:22:09.443753 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-5acd0a85-e940-459d-98ac-cd6275f93011 req-44b84aef-1006-408d-9c31-22056cf62be1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198047 Jul 27 15:22:09.447255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 51/95] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:09.524646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:09.525614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:09.561888 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.564729 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.565580 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.566020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.628580 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:09.643776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ade632f3-4e9d-4165-8b1f-70041384de67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.251462 Jul 27 15:22:09.645157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 45/96] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:09 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:09.658548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:09.660815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:09.669896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.671025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.672039 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.672689 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.697747 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:09.720088 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:09.721584 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:09.722793 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-468375bb-318b-45d4-aa8e-14b21934693a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1340 microversion: 2.20 time: 0.203408 Jul 27 15:22:09.734413 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 52/97] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:09 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1340 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:09.812445 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:09.813639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:09.830679 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.831384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:09.832961 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:09.833550 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:10.119712 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:10.130227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7a7de7c9-d87a-456d-813d-46bd9f85f37f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.481993 Jul 27 15:22:10.130227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 46/98] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:09 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:10.147763 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:10.149078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:10.156820 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:10.158429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:10.159731 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:10.160502 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:10.190704 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:10.202002 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e4647b1f-9e39-4533-816b-aa9e38ac7843 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.392255 Jul 27 15:22:10.212325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 53/99] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:09 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:10.377624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:10.384996 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9d2e331a-e223-4bf7-b2f6-257ba20a85f9 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.254541 Jul 27 15:22:10.385552 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 47/100] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:10 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:10.661920 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:10.662595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:10.668558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:10.669206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:10.669960 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:10.670803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:10.740909 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:10.741537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:10.750082 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:10.750619 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:10.752426 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:10.754523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:10.923655 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:10.940274 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-09f98a37-5a8c-490e-a022-623c3781d4b2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.281797 Jul 27 15:22:10.946254 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 54/101] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:10 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:11.040574 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:11.068789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:11.070737 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:11.071974 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-93828804-ede4-429e-b18e-dbcbe2f96544 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.334773 Jul 27 15:22:11.073017 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 48/102] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:10 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:11.146334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:11.147341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:11.157398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.159521 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.160427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.162705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.220028 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:11.221247 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:11.234390 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.235148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.237571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.238234 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.713891 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:11.733706 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-551542bf-d793-4625-b3d8-7baef0dd8b38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.591745 Jul 27 15:22:11.741165 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 55/103] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:11 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:11.747369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:11.748126 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:11.754572 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:11.756247 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.757081 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.758068 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.758746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.762130 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-45588037-9253-4a3f-ae54-7314783873c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.545849 Jul 27 15:22:11.762820 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 49/104] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:11 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:11.797635 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-1112a737-3e81-4593-b88c-318cfca1ca1e req-451d9629-5f56-4f2c-a516-ed7e88d7ab50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c2bf55-7c6b-4a6d-9135-1458daaf0613", "name": "network-vif-plugged", "status": "completed", "tag": "3b8cf6f8-2019-4de8-94cc-e634d7a1039f"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:11.799283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:11.799283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:22:11.812935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-1112a737-3e81-4593-b88c-318cfca1ca1e req-451d9629-5f56-4f2c-a516-ed7e88d7ab50 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.813827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-1112a737-3e81-4593-b88c-318cfca1ca1e req-451d9629-5f56-4f2c-a516-ed7e88d7ab50 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.834325 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-1112a737-3e81-4593-b88c-318cfca1ca1e req-451d9629-5f56-4f2c-a516-ed7e88d7ab50 service nova] Creating event network-vif-plugged:3b8cf6f8-2019-4de8-94cc-e634d7a1039f for instance 83c2bf55-7c6b-4a6d-9135-1458daaf0613 on hv-cinder-80043 Jul 27 15:22:11.840251 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-1112a737-3e81-4593-b88c-318cfca1ca1e req-451d9629-5f56-4f2c-a516-ed7e88d7ab50 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073707 Jul 27 15:22:11.849382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 50/105] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:11.856095 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-20c91a6e-81c9-44fa-9522-9f3435cb78c6 req-43668263-5554-4559-92ed-6ebe68a4baf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330a8a79-8995-4ac2-b93f-656f98368132", "tag": "a03d9438-c7a4-446b-884f-370251dd9d3c"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:11.863554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:11.863554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:22:11.872460 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-20c91a6e-81c9-44fa-9522-9f3435cb78c6 req-43668263-5554-4559-92ed-6ebe68a4baf9 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.872970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-20c91a6e-81c9-44fa-9522-9f3435cb78c6 req-43668263-5554-4559-92ed-6ebe68a4baf9 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.886457 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-20c91a6e-81c9-44fa-9522-9f3435cb78c6 req-43668263-5554-4559-92ed-6ebe68a4baf9 service nova] Creating event network-changed:a03d9438-c7a4-446b-884f-370251dd9d3c for instance 330a8a79-8995-4ac2-b93f-656f98368132 on hv-cinder-80043 Jul 27 15:22:11.891757 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-20c91a6e-81c9-44fa-9522-9f3435cb78c6 req-43668263-5554-4559-92ed-6ebe68a4baf9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040687 Jul 27 15:22:11.892761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 51/106] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:11.952352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:11.958684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:11.959493 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:11.965627 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.966080 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.966331 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2b49018c-d46f-4e2e-9584-f0abde0ddd48 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1315 microversion: 2.1 time: 0.223862 Jul 27 15:22:11.967079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:11.967534 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:11.978334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 56/107] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:11 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:12.091808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:12.092705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:12.105620 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:12.106070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:12.106911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:12.107343 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:12.195946 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:12.205175 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2b55dec7-2dac-4f78-96d1-1304611d5f46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.251041 Jul 27 15:22:12.207519 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 52/108] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:11 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:12.351770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:12.359851 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:12.361439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:12.362602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fe22b0ae-3a05-439e-a496-6ceabb2e2cbd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.275360 Jul 27 15:22:12.373597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 57/109] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:12 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:12.758082 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:12.759120 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:12.773215 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:12.774624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:12.777539 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:12.778221 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:12.780354 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:12.781534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:12.792358 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:12.793030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:12.794233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:12.807522 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.024214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:13.031925 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5d031b76-b932-4095-9c0b-81d5eac0acc2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.278703 Jul 27 15:22:13.032511 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 53/110] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:12 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:13.043111 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:13.044393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:13.056123 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:13.059066 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.060205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:13.060803 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.072173 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:13.085618 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3479e979-b126-4fce-8fcd-cf809e722579 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.309858 Jul 27 15:22:13.087412 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 58/111] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:12 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:13.221158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:13.221733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:13.231924 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:13.235758 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.236572 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:13.239004 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.265234 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:13.275725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-729b218e-c106-4ba7-99c1-86206d2eed20 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1503 microversion: 2.1 time: 0.239266 Jul 27 15:22:13.287248 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 54/112] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:13 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:13.380950 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:13.382072 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:13.390353 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:13.391088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.392044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:13.392684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.446615 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:13.455283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-df09fe98-3599-4126-8f12-5524ed1e8f5e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.237922 Jul 27 15:22:13.457404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 59/113] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:13 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:13.589327 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:13.603510 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:13.605179 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:13.606636 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6f16b02f-d268-45cc-9708-f7a8779c734e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.229443 Jul 27 15:22:13.608232 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 55/114] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:13 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:13.863153 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-7613f182-e7a2-463d-bd16-2a7c0333a62f req-6ace07a1-40cf-412f-8dcd-7db01f256c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a264be-9867-41ed-8a97-19899b508639", "name": "network-vif-plugged", "status": "completed", "tag": "2f28d58b-d9e8-4f6b-84d0-a16d154fe9ba"}, {"server_uuid": "4b978b7b-a76a-4c2b-94d7-ecdd064ddad3", "name": "network-vif-plugged", "status": "completed", "tag": "e6af182d-e796-4b48-bce1-9f47262a90dc"}, {"server_uuid": "8430fe02-1ac5-4a7b-9332-d299c54fa8b2", "name": "network-vif-plugged", "status": "completed", "tag": "c19d7c85-39cc-4b88-9f66-88f0b1054f65"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:13.865139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:13.865139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:13.873363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-7613f182-e7a2-463d-bd16-2a7c0333a62f req-6ace07a1-40cf-412f-8dcd-7db01f256c2c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:13.873977 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-7613f182-e7a2-463d-bd16-2a7c0333a62f req-6ace07a1-40cf-412f-8dcd-7db01f256c2c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:13.888631 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-7613f182-e7a2-463d-bd16-2a7c0333a62f req-6ace07a1-40cf-412f-8dcd-7db01f256c2c service nova] Creating event network-vif-plugged:2f28d58b-d9e8-4f6b-84d0-a16d154fe9ba for instance 49a264be-9867-41ed-8a97-19899b508639 on hv-cinder-80043 Jul 27 15:22:13.889142 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-7613f182-e7a2-463d-bd16-2a7c0333a62f req-6ace07a1-40cf-412f-8dcd-7db01f256c2c service nova] Creating event network-vif-plugged:e6af182d-e796-4b48-bce1-9f47262a90dc for instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 on hv-cinder-80043 Jul 27 15:22:13.889638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-7613f182-e7a2-463d-bd16-2a7c0333a62f req-6ace07a1-40cf-412f-8dcd-7db01f256c2c service nova] Creating event network-vif-plugged:c19d7c85-39cc-4b88-9f66-88f0b1054f65 for instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 on hv-cinder-80043 Jul 27 15:22:13.898596 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-7613f182-e7a2-463d-bd16-2a7c0333a62f req-6ace07a1-40cf-412f-8dcd-7db01f256c2c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039092 Jul 27 15:22:13.899181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 60/115] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:13 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:14.049295 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:14.050009 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:14.056123 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.056702 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.057575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.058240 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.105441 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:14.106436 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:14.122176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.122664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.123600 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.124177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.331138 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:14.349057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-488f3f7d-c34b-405a-b77d-f09ea9bfc313 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.303900 Jul 27 15:22:14.351112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 56/116] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:14 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:14.448928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:14.463281 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-83946597-b406-47a8-8625-6ea854e44481 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1317 microversion: 2.1 time: 0.362047 Jul 27 15:22:14.464750 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 61/117] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:14 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:14.481757 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:14.482583 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:14.489322 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.496013 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.496850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.498829 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.627479 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:14.628096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:14.633822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.634092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.635024 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.635448 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.728739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:14.737263 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ab1eadd9-a8b7-4f6d-91a2-206dc6101792 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.262911 Jul 27 15:22:14.737833 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 57/118] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:14 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:14.742236 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-89934abf-ca44-4367-ad69-66db9dd66369 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ec7d9f2-52c8-4269-b04d-28534da3c53a"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:14.744077 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-89934abf-ca44-4367-ad69-66db9dd66369 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:14.751122 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89934abf-ca44-4367-ad69-66db9dd66369 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.751563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89934abf-ca44-4367-ad69-66db9dd66369 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.752326 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89934abf-ca44-4367-ad69-66db9dd66369 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:14.752750 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89934abf-ca44-4367-ad69-66db9dd66369 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:14.852913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:14.862668 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:14.864792 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:14.866777 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d9d3af0f-e30d-467d-a453-62b2606c4c7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.243004 Jul 27 15:22:14.868045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 62/119] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:14 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:15.196291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-89934abf-ca44-4367-ad69-66db9dd66369 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "POST /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457267 Jul 27 15:22:15.196959 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 58/120] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:22:14 2021] POST /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:15.367049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:15.367683 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:15.373587 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.374015 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:15.374835 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.375229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:15.481170 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:15.481950 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:15.490513 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.491162 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:15.493024 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.493779 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:15.541548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:15.551222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f81d4106-b564-4528-b3d2-66a890a4024a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.187359 Jul 27 15:22:15.552031 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 63/121] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:15 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:15.702957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:15.712550 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7a09a916-cc30-44f5-9e43-866854bdf858 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1508 microversion: 2.1 time: 0.235874 Jul 27 15:22:15.713439 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 59/122] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:15 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:15.759953 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:15.764192 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:15.780790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.781548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:15.783435 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.784055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:15.885013 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:15.885809 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:15.900201 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.900958 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:15.901752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:15.902181 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:16.045405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:16.057265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8230c343-5784-4104-8850-eb1ce485c22f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.304361 Jul 27 15:22:16.062433 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 64/123] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:15 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:16.139844 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:16.141972 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:16.143500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:16.144627 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-67f18d31-cb03-4663-87bc-6644fc9bee81 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.263477 Jul 27 15:22:16.145458 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 60/124] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:15 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:16.567976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:16.568589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:16.574330 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:16.574799 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:16.575589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:16.575963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:16.785603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:16.794724 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d41c833f-4ff5-4b55-925d-e4c1e7c7594c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1364 microversion: 2.1 time: 0.229136 Jul 27 15:22:16.796195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 65/125] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:16 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:17.076283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:17.077015 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:17.083639 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.084086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.084853 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.085281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.162001 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:17.162760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:17.179281 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.179960 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.181703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.182286 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.495381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:17.513468 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-34e6761a-422a-4ff8-bd83-c20142f9561b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1321 microversion: 2.1 time: 0.438845 Jul 27 15:22:17.514261 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 61/126] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:17 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:17.525028 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4bc43810-ee42-4bb9-becb-80542097adda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "261d9ea0-096e-4f40-81bb-de8a86b9daa8"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:17.526258 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4bc43810-ee42-4bb9-becb-80542097adda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:17.532468 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4bc43810-ee42-4bb9-becb-80542097adda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.532935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4bc43810-ee42-4bb9-becb-80542097adda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.534545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4bc43810-ee42-4bb9-becb-80542097adda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.535242 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4bc43810-ee42-4bb9-becb-80542097adda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.561723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:17.578409 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:17.580257 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:17.581557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2c69eb34-f2fd-4b41-8086-d65b8417e8a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.423234 Jul 27 15:22:17.583050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 66/127] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:17 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:17.812156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:17.813550 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:17.824027 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.824757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.826620 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:17.828183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:17.909687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4bc43810-ee42-4bb9-becb-80542097adda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394065 Jul 27 15:22:17.910552 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 62/128] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:22:17 2021] POST /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:18.035685 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:18.042806 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8a982d91-b714-4bb8-94d5-6e066f93a24a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1550 microversion: 2.1 time: 0.234659 Jul 27 15:22:18.057288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 67/129] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:17 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1550 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:18.064808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d6578c27-e871-477e-afb0-4e529d081077 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:18.065470 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d6578c27-e871-477e-afb0-4e529d081077 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:18.076506 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6578c27-e871-477e-afb0-4e529d081077 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.077320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6578c27-e871-477e-afb0-4e529d081077 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.080786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6578c27-e871-477e-afb0-4e529d081077 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.081320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6578c27-e871-477e-afb0-4e529d081077 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.267181 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d6578c27-e871-477e-afb0-4e529d081077 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206446 Jul 27 15:22:18.267996 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 63/130] 10.222.0.37 () {58 vars in 1275 bytes} [Tue Jul 27 15:22:18 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:18.532822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:18.533430 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:18.542665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.543111 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.543881 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.544309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.602048 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:18.602696 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:18.610664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.611277 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.613347 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.613953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.761376 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:18.779728 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cbb4f97c-ff7a-4a26-bbc1-88652ef6737b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1516 microversion: 2.1 time: 0.253616 Jul 27 15:22:18.780539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 68/131] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:18 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:18.799743 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:18.801070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:18.810707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.811739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.813929 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:18.814725 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:18.868428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:18.883000 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:18.887749 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:18.890957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lazy-loading 'flavor' on Instance uuid 49a264be-9867-41ed-8a97-19899b508639 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:22:18.891211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-dff8f1b0-f5a9-42ec-936d-10cd226186d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.293353 Jul 27 15:22:18.891868 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 64/132] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:18 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:19.056701 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-03637ddb-4ca1-4167-99ab-c0d4aad7d915 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639/action" status: 200 len: 32 microversion: 2.1 time: 0.262839 Jul 27 15:22:19.063612 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 69/133] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:18 2021] POST /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639/action => generated 32 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:22:19.081297 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:19.084290 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:19.096622 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:19.097076 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:19.097926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:19.099974 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:19.397285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:19.409355 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-af5aaec5-8673-4fd3-a0a9-61785e3474e8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.335577 Jul 27 15:22:19.413373 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 65/134] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:19 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:19.909747 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:19.910435 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:19.925008 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:19.925451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:19.926228 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:19.926692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:20.139538 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:20.147890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:20.149391 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:20.153283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-91ecf625-6e48-4e13-a329-9a5bd7d581a1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.247862 Jul 27 15:22:20.154014 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 70/135] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:19 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:20.428101 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:20.428906 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:20.437050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:20.438727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:20.439569 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:20.442079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:20.538299 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fba8fa76-7000-4f93-b616-d9835e24c9c5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:20.539666 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fba8fa76-7000-4f93-b616-d9835e24c9c5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:20.549664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fba8fa76-7000-4f93-b616-d9835e24c9c5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:20.550549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fba8fa76-7000-4f93-b616-d9835e24c9c5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:20.553155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fba8fa76-7000-4f93-b616-d9835e24c9c5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:20.554260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fba8fa76-7000-4f93-b616-d9835e24c9c5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:20.777816 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fba8fa76-7000-4f93-b616-d9835e24c9c5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.243419 Jul 27 15:22:20.781966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 71/136] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:20 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:22:20.789831 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-588681ac-e6b1-4fa6-bff2-103bca123206 req-d11d32c4-3ecd-4c65-998d-377ba6ceaf50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b978b7b-a76a-4c2b-94d7-ecdd064ddad3", "tag": "e6af182d-e796-4b48-bce1-9f47262a90dc"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:20.794658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:20.794658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:20.817720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-588681ac-e6b1-4fa6-bff2-103bca123206 req-d11d32c4-3ecd-4c65-998d-377ba6ceaf50 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:20.818600 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-588681ac-e6b1-4fa6-bff2-103bca123206 req-d11d32c4-3ecd-4c65-998d-377ba6ceaf50 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:20.837628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-588681ac-e6b1-4fa6-bff2-103bca123206 req-d11d32c4-3ecd-4c65-998d-377ba6ceaf50 service nova] Creating event network-changed:e6af182d-e796-4b48-bce1-9f47262a90dc for instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 on hv-cinder-80043 Jul 27 15:22:20.844195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-588681ac-e6b1-4fa6-bff2-103bca123206 req-d11d32c4-3ecd-4c65-998d-377ba6ceaf50 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059559 Jul 27 15:22:20.845188 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 72/137] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:20.851994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-a2edce22-76cd-45b0-8498-501389c67dba req-344afba0-8e0e-4bf3-a99c-d52aeb1e432c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330a8a79-8995-4ac2-b93f-656f98368132", "name": "network-vif-plugged", "status": "completed", "tag": "a03d9438-c7a4-446b-884f-370251dd9d3c"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:20.855066 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:20.855066 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:20.872655 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-a2edce22-76cd-45b0-8498-501389c67dba req-344afba0-8e0e-4bf3-a99c-d52aeb1e432c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:20.875218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-a2edce22-76cd-45b0-8498-501389c67dba req-344afba0-8e0e-4bf3-a99c-d52aeb1e432c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:20.882928 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:20.900042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f4689ca2-ec60-4f85-bed8-b6d5bb709bc7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.473717 Jul 27 15:22:20.900619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-a2edce22-76cd-45b0-8498-501389c67dba req-344afba0-8e0e-4bf3-a99c-d52aeb1e432c service nova] Creating event network-vif-plugged:a03d9438-c7a4-446b-884f-370251dd9d3c for instance 330a8a79-8995-4ac2-b93f-656f98368132 on hv-cinder-80043 Jul 27 15:22:20.903690 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 66/138] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:20 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:20.913226 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-a2edce22-76cd-45b0-8498-501389c67dba req-344afba0-8e0e-4bf3-a99c-d52aeb1e432c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066327 Jul 27 15:22:20.914790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 73/139] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:21.173723 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:21.174686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:21.183123 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:21.184470 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:21.185327 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:21.186195 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:21.359970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:21.372101 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:21.376939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:21.378228 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-85eb08d6-868e-4296-b527-8f3d7e14f01c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.210022 Jul 27 15:22:21.380397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 67/140] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:21 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:21.789993 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-31d963f5-9167-4ab1-9b5a-5ec8903e44a1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:21.792443 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-31d963f5-9167-4ab1-9b5a-5ec8903e44a1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:21.800569 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31d963f5-9167-4ab1-9b5a-5ec8903e44a1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:21.801515 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31d963f5-9167-4ab1-9b5a-5ec8903e44a1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:21.803230 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31d963f5-9167-4ab1-9b5a-5ec8903e44a1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:21.804149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31d963f5-9167-4ab1-9b5a-5ec8903e44a1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:21.919455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:21.920073 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:21.933916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:21.934375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:21.935187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:21.939084 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:22.109876 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:22.117453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8c85051a-c192-4466-98c6-1989159b092a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.201644 Jul 27 15:22:22.118004 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 68/141] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:21 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:22.396466 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:22.397075 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:22.403041 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:22.403495 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:22.404288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:22.404703 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:22.543654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:22.553835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:22.555374 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:22.556468 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9aa41137-a55a-4419-b90f-33ccc37e8439 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.163684 Jul 27 15:22:22.557054 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 69/142] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:22 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:23.134517 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:23.135132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:23.141007 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:23.141457 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:23.142227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:23.142701 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:23.449179 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:23.457817 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f9f863c4-602e-4f28-ba0c-f9df4ed53c76 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.327353 Jul 27 15:22:23.458221 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 70/143] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:23 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:23.574253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:23.574888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:23.581087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:23.581513 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:23.582271 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:23.582735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:23.788533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:23.797133 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:23.798831 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:23.799824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cc2a4024-2ae6-4152-8571-4894c092048a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.229355 Jul 27 15:22:23.800389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 71/144] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:23 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:24.474533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:24.475229 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:24.481003 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:24.481455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:24.482219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:24.482681 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:24.624448 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:24.631853 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e9185ed6-1cbe-49f2-b298-c13771329502 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.161073 Jul 27 15:22:24.632311 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 72/145] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:24 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:24.817508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:24.818227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:24.824592 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:24.825388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:24.826214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:24.826687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:24.978092 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:24.985768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:24.987330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:24.988431 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-de516123-4353-42c7-9170-46bba3f737a0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.174726 Jul 27 15:22:24.989077 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 73/146] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:24 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:22:25.144924 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-31d963f5-9167-4ab1-9b5a-5ec8903e44a1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 3.359756 Jul 27 15:22:25.147225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 74/147] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:21 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 3363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:22:25.648340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:25.648953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:25.654741 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:25.655197 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:25.656011 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:25.656451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:25.802980 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:25.810239 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-29543375-2957-4d38-9527-fa5a4e99a921 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.165528 Jul 27 15:22:25.810874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 74/148] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:25 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:26.007086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:26.007905 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:26.014387 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:26.014817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:26.015619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:26.016046 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:26.157513 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d6015302-26dd-4946-8dff-06c97a0d88b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:26.158726 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d6015302-26dd-4946-8dff-06c97a0d88b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:26.159090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:26.164547 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6015302-26dd-4946-8dff-06c97a0d88b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:26.165182 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6015302-26dd-4946-8dff-06c97a0d88b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:26.166160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6015302-26dd-4946-8dff-06c97a0d88b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:26.166854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6015302-26dd-4946-8dff-06c97a0d88b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:26.167249 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:26.168765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:26.169844 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-48a4db67-56e3-4696-bd28-aac6c43ba77f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1406 microversion: 2.20 time: 0.166892 Jul 27 15:22:26.170679 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 75/149] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:26 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:26.350334 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d6015302-26dd-4946-8dff-06c97a0d88b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.196711 Jul 27 15:22:26.352119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 75/150] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:26 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:22:26.829496 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:26.840585 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:26.850248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:26.850920 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:26.851707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:26.852142 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:26.996327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:27.006477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e7b7f804-f022-4f4b-8fad-0f1e97cc3d23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.181957 Jul 27 15:22:27.007323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 76/151] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:26 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:27.188963 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:27.189711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:27.196133 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:27.196582 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:27.197354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:27.197793 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:27.348711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:27.357707 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:27.359334 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:27.360487 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-105c736b-0fc4-4dc6-b0e8-c051d65662d5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1598 microversion: 2.20 time: 0.175734 Jul 27 15:22:27.368371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ea50202f-2233-46fd-85d1-0b9a087cdcdf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:27.368943 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 76/152] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:22:27 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:22:27.369028 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ea50202f-2233-46fd-85d1-0b9a087cdcdf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:27.369028 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea50202f-2233-46fd-85d1-0b9a087cdcdf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:27.369028 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea50202f-2233-46fd-85d1-0b9a087cdcdf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:27.369248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea50202f-2233-46fd-85d1-0b9a087cdcdf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:27.369901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea50202f-2233-46fd-85d1-0b9a087cdcdf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:27.380056 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6157fa2f-025b-4d34-a01c-3d97e6c30838 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:27.380815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6157fa2f-025b-4d34-a01c-3d97e6c30838 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:27.387679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6157fa2f-025b-4d34-a01c-3d97e6c30838 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:27.388213 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6157fa2f-025b-4d34-a01c-3d97e6c30838 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:27.389052 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6157fa2f-025b-4d34-a01c-3d97e6c30838 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:27.389576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6157fa2f-025b-4d34-a01c-3d97e6c30838 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:27.491255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6157fa2f-025b-4d34-a01c-3d97e6c30838 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115290 Jul 27 15:22:27.492135 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 77/153] 10.222.0.37 () {60 vars in 1316 bytes} [Tue Jul 27 15:22:27 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:27.502661 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ea50202f-2233-46fd-85d1-0b9a087cdcdf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.144768 Jul 27 15:22:27.503570 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 77/154] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:27 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:22:28.024156 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:28.025379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:28.035579 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.035936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:28.036879 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.037504 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:28.224583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:28.225188 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:28.243035 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.243520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:28.244387 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.251219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:28.319235 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:22:28.460829 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6989e622-989e-4920-9d9e-219e91934e52 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "DELETE /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 204 len: 0 microversion: 2.1 time: 0.240363 Jul 27 15:22:28.463479 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 78/155] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:22:28 2021] DELETE /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:22:28.474532 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:28.475397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:28.484166 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.484609 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:28.485732 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.486407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:28.857366 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:28.866328 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-aa80c818-1f6f-4e15-87c1-0485ec729537 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.846660 Jul 27 15:22:28.867193 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 78/156] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:28 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:28.872200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-dbd95d93-651f-48b7-954f-17e7c7ea3b2f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:28.873438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-dbd95d93-651f-48b7-954f-17e7c7ea3b2f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:28.880032 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dbd95d93-651f-48b7-954f-17e7c7ea3b2f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.880509 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dbd95d93-651f-48b7-954f-17e7c7ea3b2f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:28.881275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dbd95d93-651f-48b7-954f-17e7c7ea3b2f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:28.881741 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dbd95d93-651f-48b7-954f-17e7c7ea3b2f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:29.013256 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-dbd95d93-651f-48b7-954f-17e7c7ea3b2f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.144642 Jul 27 15:22:29.013873 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 79/157] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:28 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:22:29.043678 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:29.052463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a81c4b6b-dcab-493a-8d5b-6c2b5cf261d1 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1555 microversion: 2.1 time: 0.583917 Jul 27 15:22:29.053340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 79/158] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:28 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1555 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:29.388591 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c32025db-f103-464d-af87-56db2ee4e744 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:29.389645 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c32025db-f103-464d-af87-56db2ee4e744 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:29.390693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-20560512-82b5-40bf-a2e9-621a9e57ad83 req-8c0d72da-c5fb-4c74-8284-a1e544ac36d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330a8a79-8995-4ac2-b93f-656f98368132", "tag": "a03d9438-c7a4-446b-884f-370251dd9d3c"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:29.392451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:29.392451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:29.398648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32025db-f103-464d-af87-56db2ee4e744 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:29.399101 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32025db-f103-464d-af87-56db2ee4e744 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:29.400740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32025db-f103-464d-af87-56db2ee4e744 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:29.401195 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32025db-f103-464d-af87-56db2ee4e744 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:29.401309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-20560512-82b5-40bf-a2e9-621a9e57ad83 req-8c0d72da-c5fb-4c74-8284-a1e544ac36d7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:29.401918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-20560512-82b5-40bf-a2e9-621a9e57ad83 req-8c0d72da-c5fb-4c74-8284-a1e544ac36d7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:29.414370 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-20560512-82b5-40bf-a2e9-621a9e57ad83 req-8c0d72da-c5fb-4c74-8284-a1e544ac36d7 service nova] Creating event network-changed:a03d9438-c7a4-446b-884f-370251dd9d3c for instance 330a8a79-8995-4ac2-b93f-656f98368132 on hv-cinder-80043 Jul 27 15:22:29.425546 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-20560512-82b5-40bf-a2e9-621a9e57ad83 req-8c0d72da-c5fb-4c74-8284-a1e544ac36d7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039078 Jul 27 15:22:29.426552 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 80/159] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:22:29.587763 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c32025db-f103-464d-af87-56db2ee4e744 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.203506 Jul 27 15:22:29.588795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 80/160] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:29 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:29.888870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:29.894536 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:29.910900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:29.911720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:29.913155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:29.913921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:30.024609 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-00da1eef-e5e5-4c17-8080-24574b620adf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:30.025755 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-00da1eef-e5e5-4c17-8080-24574b620adf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:30.037364 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-00da1eef-e5e5-4c17-8080-24574b620adf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:30.037810 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-00da1eef-e5e5-4c17-8080-24574b620adf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:30.041608 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-00da1eef-e5e5-4c17-8080-24574b620adf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:30.042086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-00da1eef-e5e5-4c17-8080-24574b620adf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:30.161386 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:30.170808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fff4d459-37e0-4ca4-bdb7-3345b1a3232a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.289222 Jul 27 15:22:30.179839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 81/161] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:29 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:30.186542 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-00da1eef-e5e5-4c17-8080-24574b620adf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.165109 Jul 27 15:22:30.188069 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:30.188185 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 81/162] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:30 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:22:30.189098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:30.197130 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:30.199742 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:30.200872 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:30.202006 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:30.424895 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:30.433032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-95a93c5d-c15d-4e6c-bef6-ef4be6455f1e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1555 microversion: 2.1 time: 0.251267 Jul 27 15:22:30.443897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 82/163] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:30 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:30.605115 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0d008537-7f38-4578-b38b-dec59e1ffbf4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:30.606399 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0d008537-7f38-4578-b38b-dec59e1ffbf4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:30.616091 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0d008537-7f38-4578-b38b-dec59e1ffbf4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:30.616835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0d008537-7f38-4578-b38b-dec59e1ffbf4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:30.617897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0d008537-7f38-4578-b38b-dec59e1ffbf4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:30.618337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0d008537-7f38-4578-b38b-dec59e1ffbf4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:30.776202 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0d008537-7f38-4578-b38b-dec59e1ffbf4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.176810 Jul 27 15:22:30.776202 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 82/164] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:30 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:31.188406 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:31.189014 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:31.195119 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.195798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.197059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.197679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1b63a897-c812-4a9a-8a4c-ff88474c54bf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:31.198108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.198730 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1b63a897-c812-4a9a-8a4c-ff88474c54bf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:31.207196 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b63a897-c812-4a9a-8a4c-ff88474c54bf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.207884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b63a897-c812-4a9a-8a4c-ff88474c54bf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.208653 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b63a897-c812-4a9a-8a4c-ff88474c54bf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.209087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b63a897-c812-4a9a-8a4c-ff88474c54bf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.343780 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:31.350903 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e6efdefd-8a30-461b-87f1-1483929e46f8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.166129 Jul 27 15:22:31.351476 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 83/165] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:31 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:31.444302 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1b63a897-c812-4a9a-8a4c-ff88474c54bf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.250491 Jul 27 15:22:31.445105 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 83/166] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:31 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:22:31.451151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:31.451819 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:31.459635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.460304 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.461158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.461617 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.616733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:31.625016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6bbb9111-c175-4a34-b16d-de9aea63ba28 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1555 microversion: 2.1 time: 0.177488 Jul 27 15:22:31.625577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 84/167] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:31 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:31.784936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ae86b032-1f2b-4d7f-8124-e70e5fb0d389 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:31.785953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ae86b032-1f2b-4d7f-8124-e70e5fb0d389 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:31.792438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae86b032-1f2b-4d7f-8124-e70e5fb0d389 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.792877 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae86b032-1f2b-4d7f-8124-e70e5fb0d389 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.793631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae86b032-1f2b-4d7f-8124-e70e5fb0d389 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:31.794054 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae86b032-1f2b-4d7f-8124-e70e5fb0d389 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:31.913006 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ae86b032-1f2b-4d7f-8124-e70e5fb0d389 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.131906 Jul 27 15:22:31.916049 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 84/168] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:31 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:32.058771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-b3c53ccd-4449-4b82-8a15-41c7375d71b8 req-2854b3c3-d090-4f01-96c9-45a4468615e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929e4f85-7f61-48f5-baed-a47e4becf407", "name": "network-vif-deleted", "tag": "ea60ffff-301e-4030-bf10-27f57eb5b6cd"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:32.060597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:32.060597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:32.069431 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-b3c53ccd-4449-4b82-8a15-41c7375d71b8 req-2854b3c3-d090-4f01-96c9-45a4468615e0 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.070011 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-b3c53ccd-4449-4b82-8a15-41c7375d71b8 req-2854b3c3-d090-4f01-96c9-45a4468615e0 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.098434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-b3c53ccd-4449-4b82-8a15-41c7375d71b8 req-2854b3c3-d090-4f01-96c9-45a4468615e0 service nova] Creating event network-vif-deleted:ea60ffff-301e-4030-bf10-27f57eb5b6cd for instance 929e4f85-7f61-48f5-baed-a47e4becf407 on hv-cinder-80043 Jul 27 15:22:32.099757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-b3c53ccd-4449-4b82-8a15-41c7375d71b8 req-2854b3c3-d090-4f01-96c9-45a4468615e0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044539 Jul 27 15:22:32.100696 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 85/169] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:32.368176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:32.368949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:32.375643 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.376085 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.376848 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.377280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.457734 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6d96226e-93f5-4971-9bfa-d0485af7c2b9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:32.460873 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6d96226e-93f5-4971-9bfa-d0485af7c2b9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:32.467343 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6d96226e-93f5-4971-9bfa-d0485af7c2b9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.467782 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6d96226e-93f5-4971-9bfa-d0485af7c2b9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.469208 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6d96226e-93f5-4971-9bfa-d0485af7c2b9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.469649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6d96226e-93f5-4971-9bfa-d0485af7c2b9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.517358 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:32.524785 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5c1abdab-76b7-4503-b31a-a976ad11b4c4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.160851 Jul 27 15:22:32.525355 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 85/170] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:32 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:32.583374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6d96226e-93f5-4971-9bfa-d0485af7c2b9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.132221 Jul 27 15:22:32.586435 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 86/171] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:32 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:22:32.641631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:32.642531 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:32.649985 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.650584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.651479 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.651864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.745257 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223efd1a03274a90a7d913b761b2cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76744c59ed114d22a0d7f9027f318861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:32.757379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d548ff61-e6c3-487c-a223-a5abe2bfd124 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 200 len: 1346 microversion: 2.1 time: 0.119699 Jul 27 15:22:32.757883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 86/172] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:32 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:32.924339 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3bc43f6c-7251-424b-8e75-7a04b4c85fa8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:32.925394 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3bc43f6c-7251-424b-8e75-7a04b4c85fa8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:32.931908 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bc43f6c-7251-424b-8e75-7a04b4c85fa8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.932349 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bc43f6c-7251-424b-8e75-7a04b4c85fa8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:32.933105 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bc43f6c-7251-424b-8e75-7a04b4c85fa8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:32.933532 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bc43f6c-7251-424b-8e75-7a04b4c85fa8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:33.045490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3bc43f6c-7251-424b-8e75-7a04b4c85fa8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.124887 Jul 27 15:22:33.049288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 87/173] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:32 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:33.540957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:33.541536 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:33.548622 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:33.549096 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:33.549829 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:33.550259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:33.593897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9214d923-7065-431b-9f84-fae86f52f96e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:33.594983 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9214d923-7065-431b-9f84-fae86f52f96e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:33.601607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9214d923-7065-431b-9f84-fae86f52f96e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:33.602157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9214d923-7065-431b-9f84-fae86f52f96e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:33.603117 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9214d923-7065-431b-9f84-fae86f52f96e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:33.603549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9214d923-7065-431b-9f84-fae86f52f96e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:33.687175 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:33.694321 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-eae05145-9ab9-4e7b-95a9-65b2838acc83 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.157062 Jul 27 15:22:33.694919 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 87/174] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:33 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:33.726493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9214d923-7065-431b-9f84-fae86f52f96e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.136773 Jul 27 15:22:33.727130 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 88/175] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:33 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:22:33.774384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:33.775022 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:33.781268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:33.781709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:33.782493 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:33.782916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:33.795931 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] HTTP exception thrown: Instance 929e4f85-7f61-48f5-baed-a47e4becf407 could not be found. Jul 27 15:22:33.797046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Returning 404 to user: Instance 929e4f85-7f61-48f5-baed-a47e4becf407 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:22:33.797842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9e59f256-39da-491a-b9b6-a12ef6bdfe3e tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 404 len: 111 microversion: 2.1 time: 0.026996 Jul 27 15:22:33.798427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 88/176] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:33 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:22:34.059044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fd092613-8e67-4ef1-9ae2-ed17990065d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:34.060140 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fd092613-8e67-4ef1-9ae2-ed17990065d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:34.073340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fd092613-8e67-4ef1-9ae2-ed17990065d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:34.073797 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fd092613-8e67-4ef1-9ae2-ed17990065d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:34.074599 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fd092613-8e67-4ef1-9ae2-ed17990065d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:34.075044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fd092613-8e67-4ef1-9ae2-ed17990065d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:34.193893 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fd092613-8e67-4ef1-9ae2-ed17990065d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.139833 Jul 27 15:22:34.194748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 89/177] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:34 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:34.711388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:34.712064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:34.721782 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:34.723608 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:34.725040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:34.725515 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:34.740099 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d65d45d4-7085-4456-b742-bae428708191 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:34.741741 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d65d45d4-7085-4456-b742-bae428708191 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:34.772646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d65d45d4-7085-4456-b742-bae428708191 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:34.773567 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d65d45d4-7085-4456-b742-bae428708191 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:34.782212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d65d45d4-7085-4456-b742-bae428708191 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:34.782953 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d65d45d4-7085-4456-b742-bae428708191 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:34.887485 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:34.899902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d65d45d4-7085-4456-b742-bae428708191 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 14 microversion: 2.1 time: 0.166102 Jul 27 15:22:34.901176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 90/178] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:34 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:22:34.903373 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7e333dab-67a6-4cd9-899f-2729feb2092f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.194521 Jul 27 15:22:34.904926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 89/179] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:34 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:35.104233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:35.104882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:35.113652 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.114234 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:35.115481 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.116237 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:35.133619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] HTTP exception thrown: Instance 929e4f85-7f61-48f5-baed-a47e4becf407 could not be found. Jul 27 15:22:35.134602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Returning 404 to user: Instance 929e4f85-7f61-48f5-baed-a47e4becf407 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:22:35.135347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f197395a-fac5-4b46-af4d-fb075337627f tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "DELETE /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 404 len: 111 microversion: 2.1 time: 0.035164 Jul 27 15:22:35.135890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 91/180] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:22:35 2021] DELETE /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:22:35.143834 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:35.144778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] [instance: 929e4f85-7f61-48f5-baed-a47e4becf407] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:35.151255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.151696 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:35.152451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.152881 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:35.172373 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] HTTP exception thrown: Instance 929e4f85-7f61-48f5-baed-a47e4becf407 could not be found. Jul 27 15:22:35.173081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] Returning 404 to user: Instance 929e4f85-7f61-48f5-baed-a47e4becf407 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:22:35.173983 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c4dcf28c-9c44-4cc4-801b-06b0c2e20fe5 tempest-DeleteServersTestJSON-240935663 tempest-DeleteServersTestJSON-240935663-project] 10.222.0.37 "GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407" status: 404 len: 111 microversion: 2.1 time: 0.033869 Jul 27 15:22:35.177977 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 90/181] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:35 2021] GET /compute/v2.1/servers/929e4f85-7f61-48f5-baed-a47e4becf407 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:22:35.205125 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9c467170-f785-49a5-b293-b8935170a9fa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:35.206133 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9c467170-f785-49a5-b293-b8935170a9fa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:35.212214 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c467170-f785-49a5-b293-b8935170a9fa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.212773 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c467170-f785-49a5-b293-b8935170a9fa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:35.213710 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c467170-f785-49a5-b293-b8935170a9fa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.214166 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c467170-f785-49a5-b293-b8935170a9fa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:35.307680 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-888881775", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "e7f2813b-6649-45a6-b769-67fc889c519f"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:35.323455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9c467170-f785-49a5-b293-b8935170a9fa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.122185 Jul 27 15:22:35.326972 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 92/182] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:35 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:35.363744 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] validate_networks() for [('e7f2813b-6649-45a6-b769-67fc889c519f', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:22:35.912111 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a6d0f635-20fb-4fe3-a97b-89aabb81087e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:35.913286 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a6d0f635-20fb-4fe3-a97b-89aabb81087e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:35.920807 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6d0f635-20fb-4fe3-a97b-89aabb81087e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.923607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6d0f635-20fb-4fe3-a97b-89aabb81087e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:35.927559 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6d0f635-20fb-4fe3-a97b-89aabb81087e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:35.929043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6d0f635-20fb-4fe3-a97b-89aabb81087e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:36.066105 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a6d0f635-20fb-4fe3-a97b-89aabb81087e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 6520 microversion: 2.1 time: 0.157649 Jul 27 15:22:36.069878 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 93/183] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:35 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 6520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:36.075643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:36.076562 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:36.092074 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:36.094528 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:36.095444 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:36.097143 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:36.267466 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:22:36.268505 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:22:36.269229 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:22:36.269710 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:22:36.270405 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:22:36.289454 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:36.290119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:36.291241 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:36.291870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:36.311142 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:22:36.317842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for user 7b825ab5c9074d2891ef14d3ee406e03 and project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:22:36.337486 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:22:36.340040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:22:36.398106 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4ae1fb12-6b1d-49b5-b703-abe3ae3de1e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093907 Jul 27 15:22:36.398950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:36.399426 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 91/184] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:22:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:22:36.404749 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2c82d11a-a69e-4de4-bbd9-6f61f2b54877 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:36.406207 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2c82d11a-a69e-4de4-bbd9-6f61f2b54877 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:36.407819 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-41b77248-3c32-4e0d-8d66-6adce7ad9363 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.336629 Jul 27 15:22:36.409050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 94/185] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:36 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:36.414131 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5b384f7b-cb07-468f-91e6-af9d2458aede tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:36.415004 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5b384f7b-cb07-468f-91e6-af9d2458aede tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:36.417348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c82d11a-a69e-4de4-bbd9-6f61f2b54877 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:36.417805 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c82d11a-a69e-4de4-bbd9-6f61f2b54877 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:36.420931 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c82d11a-a69e-4de4-bbd9-6f61f2b54877 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:36.422227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c82d11a-a69e-4de4-bbd9-6f61f2b54877 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:36.481126 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5b384f7b-cb07-468f-91e6-af9d2458aede tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:36.504471 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5b384f7b-cb07-468f-91e6-af9d2458aede tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1217 microversion: 2.1 time: 0.094325 Jul 27 15:22:36.507010 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 95/186] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:36 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:36.554191 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2c82d11a-a69e-4de4-bbd9-6f61f2b54877 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.153144 Jul 27 15:22:36.554885 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 92/187] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:36 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:37.081018 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c851ecd6-f42a-4e8a-9c56-76d8dafca563 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:37.082931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c851ecd6-f42a-4e8a-9c56-76d8dafca563 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:37.092398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c851ecd6-f42a-4e8a-9c56-76d8dafca563 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.093713 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c851ecd6-f42a-4e8a-9c56-76d8dafca563 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.094737 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c851ecd6-f42a-4e8a-9c56-76d8dafca563 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.095501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c851ecd6-f42a-4e8a-9c56-76d8dafca563 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.223635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c851ecd6-f42a-4e8a-9c56-76d8dafca563 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 11454 microversion: 2.1 time: 0.149860 Jul 27 15:22:37.224271 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 96/188] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:37 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 11454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:22:37.426352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:37.427114 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:37.434105 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.434588 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.435398 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.435830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.523674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:37.524746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:37.531922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.532450 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.533278 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.534138 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.606113 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:37.610714 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:37.614313 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-35597d41-655b-4985-8a3d-6cf74560b4d2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1269 microversion: 2.1 time: 0.094518 Jul 27 15:22:37.614996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 97/189] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:37 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:37.619422 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-420fdd0a-9531-49f5-8eeb-1ff6bd8004c6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:37.620306 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-420fdd0a-9531-49f5-8eeb-1ff6bd8004c6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:37.625827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-420fdd0a-9531-49f5-8eeb-1ff6bd8004c6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.626326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-420fdd0a-9531-49f5-8eeb-1ff6bd8004c6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.626662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8e369f9a-d25c-4565-8437-0f0b2c401121 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.205035 Jul 27 15:22:37.627420 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 93/190] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:37 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:37.627537 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-420fdd0a-9531-49f5-8eeb-1ff6bd8004c6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:37.627837 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-420fdd0a-9531-49f5-8eeb-1ff6bd8004c6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:37.752817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-420fdd0a-9531-49f5-8eeb-1ff6bd8004c6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.136387 Jul 27 15:22:37.753920 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 98/191] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:37 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:38.235789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8a191686-b708-485e-abea-6457662e1c65 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:38.237607 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8a191686-b708-485e-abea-6457662e1c65 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:38.249708 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8a191686-b708-485e-abea-6457662e1c65 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.251926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8a191686-b708-485e-abea-6457662e1c65 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:38.254619 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8a191686-b708-485e-abea-6457662e1c65 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.255933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8a191686-b708-485e-abea-6457662e1c65 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:38.407551 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8a191686-b708-485e-abea-6457662e1c65 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 15792 microversion: 2.1 time: 0.175293 Jul 27 15:22:38.408370 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 94/192] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:38 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 15792 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:22:38.632049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:38.633305 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:38.643901 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:38.645216 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:38.654207 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.656358 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.657017 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:38.658052 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.658744 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:38.659697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.660312 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:38.662718 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:38.823201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:38.831492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e6d093b2-442f-4554-825d-7aba96f7f65c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1275 microversion: 2.1 time: 0.203726 Jul 27 15:22:38.832151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 99/193] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:38 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:38.836878 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-42bc81bd-9a6e-4ec6-bf86-e9855bca538f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:38.837967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-42bc81bd-9a6e-4ec6-bf86-e9855bca538f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:38.844460 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42bc81bd-9a6e-4ec6-bf86-e9855bca538f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.844970 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42bc81bd-9a6e-4ec6-bf86-e9855bca538f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:38.845801 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42bc81bd-9a6e-4ec6-bf86-e9855bca538f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:38.846301 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42bc81bd-9a6e-4ec6-bf86-e9855bca538f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:39.018916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:39.027109 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-882e0bc1-75d5-4806-981a-d37ed0338201 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.387434 Jul 27 15:22:39.027830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 95/194] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:38 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:39.419167 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b4020726-2fba-4fea-8cd7-d1723882eb22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:39.420528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b4020726-2fba-4fea-8cd7-d1723882eb22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:39.427171 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b4020726-2fba-4fea-8cd7-d1723882eb22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:39.427922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b4020726-2fba-4fea-8cd7-d1723882eb22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:39.428905 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b4020726-2fba-4fea-8cd7-d1723882eb22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:39.429348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b4020726-2fba-4fea-8cd7-d1723882eb22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:41.906488 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-42bc81bd-9a6e-4ec6-bf86-e9855bca538f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 3.072877 Jul 27 15:22:41.907446 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 100/195] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:38 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 3074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:41.912922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:41.913629 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:41.931512 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:41.933942 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:41.936384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:41.936896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:41.937424 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b4020726-2fba-4fea-8cd7-d1723882eb22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 19601 microversion: 2.1 time: 2.521786 Jul 27 15:22:41.939655 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 96/196] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:39 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 19601 bytes in 2525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:41.945567 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:41.946308 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:41.954140 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:41.954954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:41.955695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:41.956308 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:42.195612 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:42.208845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f1d07c90-c7f6-47d0-b432-3826262ef906 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.294586 Jul 27 15:22:42.208845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 101/197] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:41 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:42.218930 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:42.226222 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c5add0df-1bc9-4ae9-adaa-801853ca2791 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.285156 Jul 27 15:22:42.226831 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 97/198] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:41 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:42.667875 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-eb6d974f-da34-4d87-8057-25b2a0216448 req-b9f8aac2-eac2-489d-92cb-70d5befd44a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc4a45d-82a0-42f3-be6e-e50887766ef3", "tag": "d505fe5d-eac3-4a9d-8e5d-b4beeb464099"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:42.669722 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:42.669722 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:42.685884 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-eb6d974f-da34-4d87-8057-25b2a0216448 req-b9f8aac2-eac2-489d-92cb-70d5befd44a4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:42.687635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-eb6d974f-da34-4d87-8057-25b2a0216448 req-b9f8aac2-eac2-489d-92cb-70d5befd44a4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:42.713176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-eb6d974f-da34-4d87-8057-25b2a0216448 req-b9f8aac2-eac2-489d-92cb-70d5befd44a4 service nova] Creating event network-changed:d505fe5d-eac3-4a9d-8e5d-b4beeb464099 for instance 9fc4a45d-82a0-42f3-be6e-e50887766ef3 on hv-cinder-80043 Jul 27 15:22:42.722044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-eb6d974f-da34-4d87-8057-25b2a0216448 req-b9f8aac2-eac2-489d-92cb-70d5befd44a4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056335 Jul 27 15:22:42.722044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 102/199] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:42.917391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7a6b0646-dfc6-4cdd-9a39-c2448db78911 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:42.918326 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7a6b0646-dfc6-4cdd-9a39-c2448db78911 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:42.928092 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a6b0646-dfc6-4cdd-9a39-c2448db78911 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:42.928435 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a6b0646-dfc6-4cdd-9a39-c2448db78911 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:42.929217 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a6b0646-dfc6-4cdd-9a39-c2448db78911 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:42.929728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a6b0646-dfc6-4cdd-9a39-c2448db78911 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:42.950639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5d994040-ae5c-4f65-b7e0-57176aafd875 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:42.951631 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5d994040-ae5c-4f65-b7e0-57176aafd875 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:42.968994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d994040-ae5c-4f65-b7e0-57176aafd875 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:42.969862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d994040-ae5c-4f65-b7e0-57176aafd875 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:42.971482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d994040-ae5c-4f65-b7e0-57176aafd875 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:42.984862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d994040-ae5c-4f65-b7e0-57176aafd875 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:43.117555 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7a6b0646-dfc6-4cdd-9a39-c2448db78911 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.203792 Jul 27 15:22:43.118260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 98/200] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:42 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:43.167354 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5d994040-ae5c-4f65-b7e0-57176aafd875 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 22014 microversion: 2.1 time: 0.220435 Jul 27 15:22:43.172306 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 103/201] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:42 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 22014 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:22:43.225754 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:43.226570 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:43.233214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:43.234285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:43.235339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:43.235775 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:43.245892 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:43.246745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:43.254942 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:43.255663 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:43.256921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:43.257484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:43.443207 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:43.452171 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-90cd8a9b-19b3-41d8-a9ea-85309ef5de03 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.231717 Jul 27 15:22:43.452963 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 99/202] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:43 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:43.473790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:43.481975 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2782a21d-58dc-4594-8cf3-da2374919873 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.242034 Jul 27 15:22:43.482561 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 104/203] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:43 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:44.129415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ca827c63-d801-48cc-8b59-a5572313921f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:44.130519 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ca827c63-d801-48cc-8b59-a5572313921f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:44.139285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ca827c63-d801-48cc-8b59-a5572313921f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.139285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ca827c63-d801-48cc-8b59-a5572313921f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.139285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ca827c63-d801-48cc-8b59-a5572313921f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.139285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ca827c63-d801-48cc-8b59-a5572313921f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.179471 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-46a0fccb-51fc-4874-a96c-884fc68a3c58 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:44.180988 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-46a0fccb-51fc-4874-a96c-884fc68a3c58 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:44.188591 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46a0fccb-51fc-4874-a96c-884fc68a3c58 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.189111 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46a0fccb-51fc-4874-a96c-884fc68a3c58 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.189899 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46a0fccb-51fc-4874-a96c-884fc68a3c58 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.190328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46a0fccb-51fc-4874-a96c-884fc68a3c58 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.257671 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ca827c63-d801-48cc-8b59-a5572313921f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.128606 Jul 27 15:22:44.257671 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 100/204] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:44 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:44.331531 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-46a0fccb-51fc-4874-a96c-884fc68a3c58 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 23169 microversion: 2.1 time: 0.155580 Jul 27 15:22:44.332260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 105/205] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:44 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 23169 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:44.470303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:44.471107 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:44.477648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.478093 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.478894 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.479337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.500826 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:44.501905 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:44.509338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.510161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.510983 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:44.511419 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:44.878755 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:44.885927 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d213ddeb-14ea-4c72-adc5-45083f17b1a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.420066 Jul 27 15:22:44.886734 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 101/206] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:44 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:44.898598 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:44.907712 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d1b07196-d02d-4c12-a93b-84971dfd86af tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.411786 Jul 27 15:22:44.908568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 106/207] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:44 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:45.266631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-acffc373-40c3-45fc-b2f8-ab15ae79945c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:45.267535 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-acffc373-40c3-45fc-b2f8-ab15ae79945c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:45.274084 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-acffc373-40c3-45fc-b2f8-ab15ae79945c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.274557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-acffc373-40c3-45fc-b2f8-ab15ae79945c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:45.275323 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-acffc373-40c3-45fc-b2f8-ab15ae79945c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.275750 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-acffc373-40c3-45fc-b2f8-ab15ae79945c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:45.342222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1f93170f-d7d5-4c5f-87fb-75e0d4e72f3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:45.349494 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1f93170f-d7d5-4c5f-87fb-75e0d4e72f3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:45.355814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f93170f-d7d5-4c5f-87fb-75e0d4e72f3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.356492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f93170f-d7d5-4c5f-87fb-75e0d4e72f3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:45.357260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f93170f-d7d5-4c5f-87fb-75e0d4e72f3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.357840 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f93170f-d7d5-4c5f-87fb-75e0d4e72f3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:45.372371 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-acffc373-40c3-45fc-b2f8-ab15ae79945c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 14 microversion: 2.20 time: 0.110048 Jul 27 15:22:45.376909 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 102/208] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:45 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:45.485331 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1f93170f-d7d5-4c5f-87fb-75e0d4e72f3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 24271 microversion: 2.1 time: 0.146326 Jul 27 15:22:45.486692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 107/209] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:45 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 24271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:45.911212 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:45.912319 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:45.925443 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:45.926508 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:45.931902 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.932384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:45.934365 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.934842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:45.935589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.936243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:45.937884 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:45.938541 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:46.183625 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:46.203498 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-335b1613-4a42-4aa5-8cad-3ca6877734fc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.282402 Jul 27 15:22:46.211352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 108/210] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:45 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:46.246002 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:46.257288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-caf9ad63-0a15-45a6-9531-b7daff9d64c1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.353639 Jul 27 15:22:46.257874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 103/211] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:45 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:46.383610 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fa9d22f9-c142-4e3f-be31-6f8bf13e917e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:46.384519 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fa9d22f9-c142-4e3f-be31-6f8bf13e917e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:46.390762 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fa9d22f9-c142-4e3f-be31-6f8bf13e917e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:46.391285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fa9d22f9-c142-4e3f-be31-6f8bf13e917e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:46.392125 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fa9d22f9-c142-4e3f-be31-6f8bf13e917e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:46.394013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fa9d22f9-c142-4e3f-be31-6f8bf13e917e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:46.496671 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c0a4394d-3737-4d5c-ab97-69217666556a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:46.497582 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c0a4394d-3737-4d5c-ab97-69217666556a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:46.503395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c0a4394d-3737-4d5c-ab97-69217666556a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:46.503841 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c0a4394d-3737-4d5c-ab97-69217666556a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:46.504633 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c0a4394d-3737-4d5c-ab97-69217666556a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:46.505065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c0a4394d-3737-4d5c-ab97-69217666556a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:49.201673 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fa9d22f9-c142-4e3f-be31-6f8bf13e917e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 15064 microversion: 2.20 time: 2.821453 Jul 27 15:22:49.202240 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 109/212] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:46 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 15064 bytes in 2823 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:49.207516 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:49.208195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:49.214377 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:49.214849 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:49.215602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:49.216024 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:49.249201 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c0a4394d-3737-4d5c-ab97-69217666556a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 26728 microversion: 2.1 time: 2.756054 Jul 27 15:22:49.250509 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 104/213] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:46 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 26728 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:49.255562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:49.256256 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:49.262830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:49.263277 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:49.264044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:49.264474 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:49.395642 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:49.402836 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6c808df2-2993-4f00-8430-47335edb7aa6 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.199410 Jul 27 15:22:49.403401 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 110/214] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:49 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:49.442020 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:49.449173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-115810a6-b690-46ed-b369-89ca9c15368d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.197799 Jul 27 15:22:49.449733 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 105/215] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:49 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:50.213316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-56b1bba3-f545-4c26-b0a6-f419094a86af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:50.214162 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-56b1bba3-f545-4c26-b0a6-f419094a86af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:50.220823 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56b1bba3-f545-4c26-b0a6-f419094a86af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.221275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56b1bba3-f545-4c26-b0a6-f419094a86af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.222169 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56b1bba3-f545-4c26-b0a6-f419094a86af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.222684 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56b1bba3-f545-4c26-b0a6-f419094a86af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.260957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-539a92cb-5277-4a57-8d51-26e2b5412656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:50.261869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-539a92cb-5277-4a57-8d51-26e2b5412656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:50.268174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-539a92cb-5277-4a57-8d51-26e2b5412656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.268619 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-539a92cb-5277-4a57-8d51-26e2b5412656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.269384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-539a92cb-5277-4a57-8d51-26e2b5412656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.269819 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-539a92cb-5277-4a57-8d51-26e2b5412656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.376098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-56b1bba3-f545-4c26-b0a6-f419094a86af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 17861 microversion: 2.20 time: 0.166380 Jul 27 15:22:50.376720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 111/216] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:50 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 17861 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:50.406684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-539a92cb-5277-4a57-8d51-26e2b5412656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 27171 microversion: 2.1 time: 0.149069 Jul 27 15:22:50.411108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 106/217] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:50 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 27171 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:50.419461 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:50.420396 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:50.426837 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.427276 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.428028 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.428453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.467224 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:50.467836 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:50.479050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.479510 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.480339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:50.482156 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:50.620900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:50.629117 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0d5df289-2e7e-4493-bddc-a44fe7bd4319 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.213534 Jul 27 15:22:50.629909 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 112/218] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:50 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:50.692641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:50.700667 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b41d1dca-90e3-4ba9-9fc0-0f4d8df031d6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.237198 Jul 27 15:22:50.710965 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 107/219] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:50 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:51.387945 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-28555bcd-e446-476a-8ce2-0d4e4a81a4fc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:51.389095 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-28555bcd-e446-476a-8ce2-0d4e4a81a4fc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:51.395477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28555bcd-e446-476a-8ce2-0d4e4a81a4fc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.400936 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28555bcd-e446-476a-8ce2-0d4e4a81a4fc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.401886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28555bcd-e446-476a-8ce2-0d4e4a81a4fc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.402561 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28555bcd-e446-476a-8ce2-0d4e4a81a4fc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.418201 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-55498a36-90bb-466b-bafe-bb5bc92071d1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:51.419152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-55498a36-90bb-466b-bafe-bb5bc92071d1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:51.425743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55498a36-90bb-466b-bafe-bb5bc92071d1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.426184 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55498a36-90bb-466b-bafe-bb5bc92071d1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.426970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55498a36-90bb-466b-bafe-bb5bc92071d1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.427399 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55498a36-90bb-466b-bafe-bb5bc92071d1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.553714 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-28555bcd-e446-476a-8ce2-0d4e4a81a4fc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 18398 microversion: 2.20 time: 0.170307 Jul 27 15:22:51.554268 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 113/220] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:51 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 18398 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:51.580581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-55498a36-90bb-466b-bafe-bb5bc92071d1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 27575 microversion: 2.1 time: 0.166093 Jul 27 15:22:51.581211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 108/221] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:51 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 27575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:51.646503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:51.647208 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:51.653549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.653999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.654791 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.655224 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.717356 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:51.718163 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:51.725319 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.725770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.726566 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:51.727001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:51.833214 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:51.840375 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fef8da5e-b1aa-4888-a908-f51632b57b36 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.197877 Jul 27 15:22:51.841153 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 114/222] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:51 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:51.900551 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:51.911653 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ef537fd9-bcfa-435d-be52-a58a7afa9f60 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.198211 Jul 27 15:22:51.913503 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 109/223] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:51 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:52.058441 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-ec7902b8-ac81-4247-9bfe-89b9e37b7130 req-1e4ee901-94b5-411f-9eee-98af54e48f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc4a45d-82a0-42f3-be6e-e50887766ef3", "name": "network-vif-plugged", "status": "completed", "tag": "d505fe5d-eac3-4a9d-8e5d-b4beeb464099"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:52.059971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:22:52.059971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:22:52.068591 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-ec7902b8-ac81-4247-9bfe-89b9e37b7130 req-1e4ee901-94b5-411f-9eee-98af54e48f1b service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.069090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-ec7902b8-ac81-4247-9bfe-89b9e37b7130 req-1e4ee901-94b5-411f-9eee-98af54e48f1b service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.080539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-ec7902b8-ac81-4247-9bfe-89b9e37b7130 req-1e4ee901-94b5-411f-9eee-98af54e48f1b service nova] Creating event network-vif-plugged:d505fe5d-eac3-4a9d-8e5d-b4beeb464099 for instance 9fc4a45d-82a0-42f3-be6e-e50887766ef3 on hv-cinder-80043 Jul 27 15:22:52.085529 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-ec7902b8-ac81-4247-9bfe-89b9e37b7130 req-1e4ee901-94b5-411f-9eee-98af54e48f1b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030691 Jul 27 15:22:52.086418 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 115/224] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:22:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:22:52.565101 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e1f924bc-848b-43ab-a2ee-9928cec6972c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:52.566001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e1f924bc-848b-43ab-a2ee-9928cec6972c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:52.574400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1f924bc-848b-43ab-a2ee-9928cec6972c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.575152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1f924bc-848b-43ab-a2ee-9928cec6972c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.576025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1f924bc-848b-43ab-a2ee-9928cec6972c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.576463 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1f924bc-848b-43ab-a2ee-9928cec6972c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.592836 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2b30a99a-4f06-4b8b-b127-6d66fc2610b6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:52.593814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2b30a99a-4f06-4b8b-b127-6d66fc2610b6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:52.599813 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b30a99a-4f06-4b8b-b127-6d66fc2610b6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.600257 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b30a99a-4f06-4b8b-b127-6d66fc2610b6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.601022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b30a99a-4f06-4b8b-b127-6d66fc2610b6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.601450 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b30a99a-4f06-4b8b-b127-6d66fc2610b6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.914412 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e1f924bc-848b-43ab-a2ee-9928cec6972c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 20984 microversion: 2.20 time: 0.353271 Jul 27 15:22:52.915249 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 110/225] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:52 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 20984 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:52.920415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:52.921100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:52.928178 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.928624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.929396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.930288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.972931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2b30a99a-4f06-4b8b-b127-6d66fc2610b6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 27857 microversion: 2.1 time: 0.384147 Jul 27 15:22:52.973573 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 116/226] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:52 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 27857 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:52.981045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:52.981913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:52.988645 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.989097 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:52.989893 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:52.990320 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:53.101796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:53.116056 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-be94b3c7-72e6-45fb-a621-adf59504bb22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.199503 Jul 27 15:22:53.116742 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 111/227] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:52 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:53.181830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:53.189559 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e5a9fe1f-8957-45fc-ad05-2ad8ac6c1e85 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1317 microversion: 2.1 time: 0.214805 Jul 27 15:22:53.190125 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 117/228] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:52 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:53.926521 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ab76efbd-7f0d-47d6-9d32-d3d84d662f5d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:53.928294 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ab76efbd-7f0d-47d6-9d32-d3d84d662f5d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:53.937717 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab76efbd-7f0d-47d6-9d32-d3d84d662f5d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:53.938736 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab76efbd-7f0d-47d6-9d32-d3d84d662f5d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:53.940568 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab76efbd-7f0d-47d6-9d32-d3d84d662f5d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:53.941328 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab76efbd-7f0d-47d6-9d32-d3d84d662f5d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:53.985767 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cc88f552-ae7d-4e83-9b9d-4be465bff789 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:53.988532 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cc88f552-ae7d-4e83-9b9d-4be465bff789 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:53.996036 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cc88f552-ae7d-4e83-9b9d-4be465bff789 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:53.997083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cc88f552-ae7d-4e83-9b9d-4be465bff789 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:53.998282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cc88f552-ae7d-4e83-9b9d-4be465bff789 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:53.998944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cc88f552-ae7d-4e83-9b9d-4be465bff789 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.082762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ab76efbd-7f0d-47d6-9d32-d3d84d662f5d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 22204 microversion: 2.20 time: 0.159947 Jul 27 15:22:54.083531 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 112/229] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:53 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 22204 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:54.134124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cc88f552-ae7d-4e83-9b9d-4be465bff789 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28168 microversion: 2.1 time: 0.152881 Jul 27 15:22:54.134658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:54.135404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 118/230] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:53 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:54.135818 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:54.143048 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.143745 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.144533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.144972 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.206963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:54.207792 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:54.214638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.215407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.216259 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.216761 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.429287 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:54.446281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-48030dd2-875a-46b7-96dd-23c1e0e8dc21 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.316114 Jul 27 15:22:54.451473 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 113/231] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:54 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:54.515333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:54.532747 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8c172dc0-f1b6-4433-b706-8a735fcef723 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1507 microversion: 2.1 time: 0.329918 Jul 27 15:22:54.534549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 119/232] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:54 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:54.550316 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "261d9ea0-096e-4f40-81bb-de8a86b9daa8"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:54.551407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:54.557461 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.557910 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.558801 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.559205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.688418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] HTTP exception thrown: Invalid volume: volume 261d9ea0-096e-4f40-81bb-de8a86b9daa8 is already attached to instances: 83c2bf55-7c6b-4a6d-9135-1458daaf0613 Jul 27 15:22:54.689065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Returning 400 to user: Invalid volume: volume 261d9ea0-096e-4f40-81bb-de8a86b9daa8 is already attached to instances: 83c2bf55-7c6b-4a6d-9135-1458daaf0613 {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:22:54.689911 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5d9558af-80e1-4093-91d3-5bfcd7e71373 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143474 Jul 27 15:22:54.690455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 114/233] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:22:54 2021] POST /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3/os-volume_attachments => generated 174 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:22:54.759357 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:54.759846 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:54.765787 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.766233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.767136 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:54.767562 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:54.917899 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lazy-loading 'services' on Instance uuid 83c2bf55-7c6b-4a6d-9135-1458daaf0613 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:22:55.035839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4edfeade-69ea-440b-9331-2139599a5681 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "DELETE /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613/os-volume_attachments/261d9ea0-096e-4f40-81bb-de8a86b9daa8" status: 202 len: 0 microversion: 2.1 time: 0.280114 Jul 27 15:22:55.037154 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 120/234] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:22:54 2021] DELETE /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613/os-volume_attachments/261d9ea0-096e-4f40-81bb-de8a86b9daa8 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:55.094176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8c022946-74d1-487f-aa2e-2586d6af94d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:55.096500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8c022946-74d1-487f-aa2e-2586d6af94d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:55.101730 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c022946-74d1-487f-aa2e-2586d6af94d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:55.102183 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c022946-74d1-487f-aa2e-2586d6af94d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:55.103012 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c022946-74d1-487f-aa2e-2586d6af94d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:55.103449 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8c022946-74d1-487f-aa2e-2586d6af94d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:55.146661 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2db081d7-5750-4b9f-95f7-58a37e33d20f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:55.149106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2db081d7-5750-4b9f-95f7-58a37e33d20f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:55.162533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2db081d7-5750-4b9f-95f7-58a37e33d20f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:55.162996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2db081d7-5750-4b9f-95f7-58a37e33d20f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:55.163853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2db081d7-5750-4b9f-95f7-58a37e33d20f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:55.164292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2db081d7-5750-4b9f-95f7-58a37e33d20f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:55.282200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8c022946-74d1-487f-aa2e-2586d6af94d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 23218 microversion: 2.20 time: 0.191307 Jul 27 15:22:55.286888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 115/235] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:55 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 23218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:55.310539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2db081d7-5750-4b9f-95f7-58a37e33d20f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28168 microversion: 2.1 time: 0.168535 Jul 27 15:22:55.311400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 121/236] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:55 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:22:55.466760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:55.467803 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:55.475088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:55.475571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:55.476574 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:55.477011 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:55.623145 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:55.630883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-884632dc-3ed9-4d31-a0d3-53fd8cf7c169 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.169601 Jul 27 15:22:55.631678 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 116/237] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:55 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:56.307506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-53c16b54-03de-4d68-bc8c-caf7410bd4db tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:56.308527 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-53c16b54-03de-4d68-bc8c-caf7410bd4db tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:56.319868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-53c16b54-03de-4d68-bc8c-caf7410bd4db tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:56.320602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-53c16b54-03de-4d68-bc8c-caf7410bd4db tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:56.321592 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-53c16b54-03de-4d68-bc8c-caf7410bd4db tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:56.324221 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-53c16b54-03de-4d68-bc8c-caf7410bd4db tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:56.324793 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c32aa413-7467-4371-bfa5-644803371d99 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:56.325796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c32aa413-7467-4371-bfa5-644803371d99 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:56.340499 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32aa413-7467-4371-bfa5-644803371d99 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:56.346621 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32aa413-7467-4371-bfa5-644803371d99 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:56.352140 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32aa413-7467-4371-bfa5-644803371d99 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:56.354737 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c32aa413-7467-4371-bfa5-644803371d99 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:56.479994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-53c16b54-03de-4d68-bc8c-caf7410bd4db tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 24466 microversion: 2.20 time: 0.188902 Jul 27 15:22:56.480778 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 122/238] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:56 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 24466 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:56.514820 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c32aa413-7467-4371-bfa5-644803371d99 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28168 microversion: 2.1 time: 0.194157 Jul 27 15:22:56.515907 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 117/239] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:56 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28168 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:56.517807 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1411678378", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "e7f2813b-6649-45a6-b769-67fc889c519f"}]}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:56.579424 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.network.neutron [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] validate_networks() for [('e7f2813b-6649-45a6-b769-67fc889c519f', None, None, None)] {{(pid=107332) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:22:56.648296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:56.648990 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:56.656838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:56.657395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:56.658518 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:56.658951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:56.901962 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:56.913303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bc5bf4ce-eb5d-4dc1-b9b7-ded089b18a4e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.269001 Jul 27 15:22:56.914064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 118/240] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:56 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:22:57.157852 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:22:57.158272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:22:57.158774 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:22:57.159183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:22:57.159589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:22:57.168036 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.168482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:57.169303 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.169712 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:57.186765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:22:57.190912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for user 7b825ab5c9074d2891ef14d3ee406e03 and project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:22:57.201535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Going to run 1 instances... {{(pid=107332) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:22:57.203953 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:22:57.248996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3b4a2a11-ab80-4815-a772-3fab2aa40d9f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735931 Jul 27 15:22:57.254801 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 123/241] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:22:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:22:57.260014 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3f3e9e82-6aec-4d40-8c90-2c589aafa278 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:57.260629 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3f3e9e82-6aec-4d40-8c90-2c589aafa278 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:57.332303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3f3e9e82-6aec-4d40-8c90-2c589aafa278 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:57.339269 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3f3e9e82-6aec-4d40-8c90-2c589aafa278 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1218 microversion: 2.1 time: 0.083025 Jul 27 15:22:57.348883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 119/242] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:57 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:57.494219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2061c3ad-0610-4ab8-844e-06a5a7c621e9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:57.495896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2061c3ad-0610-4ab8-844e-06a5a7c621e9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:57.504456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2061c3ad-0610-4ab8-844e-06a5a7c621e9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.505023 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2061c3ad-0610-4ab8-844e-06a5a7c621e9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:57.505880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2061c3ad-0610-4ab8-844e-06a5a7c621e9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.506407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2061c3ad-0610-4ab8-844e-06a5a7c621e9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:57.528252 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f47cd271-77c0-46e9-b7cc-2edc99608192 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:57.529537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f47cd271-77c0-46e9-b7cc-2edc99608192 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:57.538037 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f47cd271-77c0-46e9-b7cc-2edc99608192 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.538508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f47cd271-77c0-46e9-b7cc-2edc99608192 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:57.539318 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f47cd271-77c0-46e9-b7cc-2edc99608192 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.539754 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f47cd271-77c0-46e9-b7cc-2edc99608192 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:57.637546 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2061c3ad-0610-4ab8-844e-06a5a7c621e9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 25385 microversion: 2.20 time: 0.148044 Jul 27 15:22:57.641325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 124/243] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:57 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 25385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:22:57.699497 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f47cd271-77c0-46e9-b7cc-2edc99608192 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28459 microversion: 2.1 time: 0.175363 Jul 27 15:22:57.700162 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 120/244] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:57 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28459 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:22:57.931738 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:57.932562 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:57.938916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.939365 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:57.940144 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:57.940575 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:58.200107 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:58.209828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ea65847d-4580-4882-99d7-503db302bd4f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.282293 Jul 27 15:22:58.212907 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 125/245] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:57 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:58.357727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:58.358435 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:58.368767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:58.369222 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:58.370007 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:58.370440 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:58.521618 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:58.530450 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b501e774-b95b-40f4-8510-c18948d37be1 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1278 microversion: 2.1 time: 0.177370 Jul 27 15:22:58.531449 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 121/246] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:58 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:58.649659 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-63279f2c-e2cc-4fec-8c0d-fc5e4c47520a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:58.650723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-63279f2c-e2cc-4fec-8c0d-fc5e4c47520a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:58.660393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63279f2c-e2cc-4fec-8c0d-fc5e4c47520a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:58.660918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63279f2c-e2cc-4fec-8c0d-fc5e4c47520a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:58.661770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63279f2c-e2cc-4fec-8c0d-fc5e4c47520a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:58.663810 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63279f2c-e2cc-4fec-8c0d-fc5e4c47520a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:58.711418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-750cc241-007f-4d94-8e93-0baa82ec067c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:58.712329 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-750cc241-007f-4d94-8e93-0baa82ec067c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:58.720299 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-750cc241-007f-4d94-8e93-0baa82ec067c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:58.720751 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-750cc241-007f-4d94-8e93-0baa82ec067c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:58.721537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-750cc241-007f-4d94-8e93-0baa82ec067c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:58.721970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-750cc241-007f-4d94-8e93-0baa82ec067c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:58.878849 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-63279f2c-e2cc-4fec-8c0d-fc5e4c47520a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 26564 microversion: 2.20 time: 0.233278 Jul 27 15:22:58.879595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 126/247] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:58 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 26564 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:22:58.931429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-750cc241-007f-4d94-8e93-0baa82ec067c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28627 microversion: 2.1 time: 0.223852 Jul 27 15:22:58.932062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 122/248] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:22:58 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28627 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:22:59.227024 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:59.227962 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:59.234922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:59.235560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:59.237057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:59.237638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:59.457103 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:59.464866 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c6822ca8-b2ae-4fa4-8994-47d48ac9da22 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.241726 Jul 27 15:22:59.469242 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 127/249] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:59 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:59.548943 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:22:59.550430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:59.557733 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:59.558581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:59.559923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:59.560663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:59.725637 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:22:59.733014 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-521d0b05-a71b-4ce1-abe2-329f7785dd1f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.189330 Jul 27 15:22:59.743319 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 123/250] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:22:59 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:22:59.890493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-68986861-624e-4dd8-8f17-4b4278d2c62c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:59.891498 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-68986861-624e-4dd8-8f17-4b4278d2c62c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:22:59.902796 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68986861-624e-4dd8-8f17-4b4278d2c62c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:59.903323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68986861-624e-4dd8-8f17-4b4278d2c62c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:59.904210 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68986861-624e-4dd8-8f17-4b4278d2c62c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:22:59.904702 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68986861-624e-4dd8-8f17-4b4278d2c62c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:22:59.919651 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1324452108", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "0022a182-af30-461d-881d-a8e0230ebcce"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:22:59.991610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] validate_networks() for [('0022a182-af30-461d-881d-a8e0230ebcce', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:23:00.034982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-68986861-624e-4dd8-8f17-4b4278d2c62c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 27239 microversion: 2.20 time: 0.148080 Jul 27 15:23:00.035603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 128/251] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:22:59 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 27239 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:00.042721 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-46d9450d-1988-4aaf-b8b8-6cf0c33b12f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:00.043700 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-46d9450d-1988-4aaf-b8b8-6cf0c33b12f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:00.050505 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46d9450d-1988-4aaf-b8b8-6cf0c33b12f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.051148 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46d9450d-1988-4aaf-b8b8-6cf0c33b12f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.051911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46d9450d-1988-4aaf-b8b8-6cf0c33b12f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.052346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-46d9450d-1988-4aaf-b8b8-6cf0c33b12f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.160097 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-46d9450d-1988-4aaf-b8b8-6cf0c33b12f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28627 microversion: 2.1 time: 0.122908 Jul 27 15:23:00.160773 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 129/252] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:00 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28627 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:00.166020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-313c3dad-430d-447a-a0a3-e09e2a7da571 req-d7cea367-c55d-4d3a-aab6-338d47602e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f5caae-fb56-41ed-8695-8b18f89a83d9", "tag": "d2fa1e3e-69e0-4fdd-aae2-d048e8f8be3c"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:00.167501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:00.167501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:23:00.175506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-313c3dad-430d-447a-a0a3-e09e2a7da571 req-d7cea367-c55d-4d3a-aab6-338d47602e2d service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.175946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-313c3dad-430d-447a-a0a3-e09e2a7da571 req-d7cea367-c55d-4d3a-aab6-338d47602e2d service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.186939 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-313c3dad-430d-447a-a0a3-e09e2a7da571 req-d7cea367-c55d-4d3a-aab6-338d47602e2d service nova] Creating event network-changed:d2fa1e3e-69e0-4fdd-aae2-d048e8f8be3c for instance 32f5caae-fb56-41ed-8695-8b18f89a83d9 on hv-cinder-80043 Jul 27 15:23:00.191573 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-313c3dad-430d-447a-a0a3-e09e2a7da571 req-d7cea367-c55d-4d3a-aab6-338d47602e2d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029290 Jul 27 15:23:00.192867 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 130/253] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:00.381919 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:23:00.382339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:23:00.382930 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:23:00.383407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:23:00.383883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:23:00.393960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.394529 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.395414 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.395909 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.415810 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Getting quotas for project 60eedbf75f734b36b60ba0bf2bea7123. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:23:00.420172 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Getting quotas for user 2424381d2fde4c47a559a821f327ac4a and project 60eedbf75f734b36b60ba0bf2bea7123. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:23:00.431816 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:23:00.434233 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:23:00.482796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-52d219a0-50d1-4e14-a5de-5a5216f73f25 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567004 Jul 27 15:23:00.484232 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 124/254] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:22:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:23:00.494174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:00.495861 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f6bc921b-0c53-4c58-8b71-bb0e3f4e958e tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:00.496233 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f6bc921b-0c53-4c58-8b71-bb0e3f4e958e tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:00.497293 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:00.516071 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.516766 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.518391 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.518997 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.598660 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f6bc921b-0c53-4c58-8b71-bb0e3f4e958e tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:00.605136 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f6bc921b-0c53-4c58-8b71-bb0e3f4e958e tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1214 microversion: 2.1 time: 0.114413 Jul 27 15:23:00.606078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 125/255] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:00 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:00.737548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:00.746300 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e1390ff6-7c21-44e2-a1d8-9e68e97de3bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.264694 Jul 27 15:23:00.751142 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:00.752046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:00.757026 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 131/256] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:00 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:00.761224 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.763281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.765441 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:00.767140 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:00.939036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:00.946906 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b85cd627-4aed-4631-852f-e0e6ffc43a09 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.200604 Jul 27 15:23:00.947572 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 126/257] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:00 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:01.047251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-56fed790-23fb-4f48-921b-4a13f5170e10 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:01.048222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-56fed790-23fb-4f48-921b-4a13f5170e10 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:01.054457 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56fed790-23fb-4f48-921b-4a13f5170e10 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:01.054935 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56fed790-23fb-4f48-921b-4a13f5170e10 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:01.055717 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56fed790-23fb-4f48-921b-4a13f5170e10 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:01.056154 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56fed790-23fb-4f48-921b-4a13f5170e10 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:01.171913 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-75dc0977-9565-4b7b-ba79-d892f7161f6c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:01.172991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-75dc0977-9565-4b7b-ba79-d892f7161f6c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:01.179096 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-75dc0977-9565-4b7b-ba79-d892f7161f6c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:01.179642 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-75dc0977-9565-4b7b-ba79-d892f7161f6c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:01.180481 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-75dc0977-9565-4b7b-ba79-d892f7161f6c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:01.180982 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-75dc0977-9565-4b7b-ba79-d892f7161f6c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:04.001005 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-56fed790-23fb-4f48-921b-4a13f5170e10 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 27648 microversion: 2.20 time: 2.957632 Jul 27 15:23:04.004865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 132/258] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:01 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 27648 bytes in 2959 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:04.006494 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:04.007247 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:04.013524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:04.013961 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:04.014743 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:04.015167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:04.076782 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:04.084700 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-58a62e70-3a68-443f-b149-828a997426b1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1210 microversion: 2.1 time: 0.081746 Jul 27 15:23:04.085402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 133/259] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:04 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:04.099538 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:04.100151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:04.105790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:04.106233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:04.107096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:04.107522 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:04.122891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-75dc0977-9565-4b7b-ba79-d892f7161f6c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28627 microversion: 2.1 time: 2.954604 Jul 27 15:23:04.126811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 127/260] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:01 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28627 bytes in 2956 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:23:04.128717 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:04.129427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:04.135978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:04.136416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:04.145015 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:04.145546 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:04.286667 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:04.296194 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-95f95c8f-ac82-4712-bc08-e25b0e132190 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.199988 Jul 27 15:23:04.296834 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 134/261] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:04 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:04.338771 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:04.347535 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ac507d91-daae-431f-83f2-1751074bb2fa tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.222124 Jul 27 15:23:04.348111 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 128/262] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:04 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:05.014758 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-854012cf-c68d-46b3-bbff-476a8cdbaab8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:05.016187 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-854012cf-c68d-46b3-bbff-476a8cdbaab8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:05.024799 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-854012cf-c68d-46b3-bbff-476a8cdbaab8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.025259 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-854012cf-c68d-46b3-bbff-476a8cdbaab8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.026103 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-854012cf-c68d-46b3-bbff-476a8cdbaab8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.026567 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-854012cf-c68d-46b3-bbff-476a8cdbaab8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.102091 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:05.102659 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:05.108284 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.108727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.109586 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.109910 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.163590 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-854012cf-c68d-46b3-bbff-476a8cdbaab8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28195 microversion: 2.20 time: 0.153894 Jul 27 15:23:05.164240 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 135/263] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:05 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28195 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:05.172503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-97ac5005-42da-4221-b548-5d44ac944886 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:05.173915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:05.174319 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-97ac5005-42da-4221-b548-5d44ac944886 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:05.181246 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-87c8c8f2-7ee6-425d-8445-6a5e6b773dfa tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1272 microversion: 2.1 time: 0.082962 Jul 27 15:23:05.181813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 129/264] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:05 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:05.190760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-97ac5005-42da-4221-b548-5d44ac944886 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.190760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-97ac5005-42da-4221-b548-5d44ac944886 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.190760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-97ac5005-42da-4221-b548-5d44ac944886 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.190760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-97ac5005-42da-4221-b548-5d44ac944886 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.312624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:05.313230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:05.319062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.319506 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.320310 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.320826 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.458799 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:05.466824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-719da159-5ed0-4562-91c3-693c14d1cf6d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.157874 Jul 27 15:23:05.467393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 130/265] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:05 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:05.473717 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:05.474320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:05.479896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.480452 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.481378 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:05.481808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:05.615125 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:05.622509 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b9491926-9b0f-4f20-93c4-e8c460f4d6a6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.154051 Jul 27 15:23:05.623215 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 131/266] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:05 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:06.175621 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e28c70d7-5be2-4eae-8124-95a6d074f466 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:06.176534 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e28c70d7-5be2-4eae-8124-95a6d074f466 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:06.182522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e28c70d7-5be2-4eae-8124-95a6d074f466 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:06.182920 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e28c70d7-5be2-4eae-8124-95a6d074f466 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:06.183688 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e28c70d7-5be2-4eae-8124-95a6d074f466 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:06.184124 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e28c70d7-5be2-4eae-8124-95a6d074f466 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:08.343364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-97ac5005-42da-4221-b548-5d44ac944886 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28627 microversion: 2.1 time: 3.174781 Jul 27 15:23:08.346933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 136/267] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:05 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28627 bytes in 3176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:08.348884 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:08.349571 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:08.355868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:08.356314 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:08.357069 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:08.357501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:08.414416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e28c70d7-5be2-4eae-8124-95a6d074f466 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28195 microversion: 2.20 time: 2.242278 Jul 27 15:23:08.416213 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 132/268] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:06 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28195 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:08.421499 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:08.422718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:08.435631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:08.436188 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:08.437427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:08.438212 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:08.550716 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:08.558224 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c366399a-8ba0-4dc3-8f3c-373044df770c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.212886 Jul 27 15:23:08.558835 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 137/269] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:08 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:08.563439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:08.564843 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:08.570593 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:08.571033 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:08.571799 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:08.572231 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:08.622728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:08.631397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ed616b84-3aaf-4c50-aad2-a45c13e2d47e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.213740 Jul 27 15:23:08.631979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 133/270] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:08 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:08.864045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:08.872214 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a07a1921-7042-4efd-a861-58941b794f75 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.312047 Jul 27 15:23:08.872810 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 138/271] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:08 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:08.989137 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-4b650356-c649-4ff3-a552-1c03e25af3ec req-dab980a1-c0c1-4347-832e-746d62469368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef", "tag": "6340c9ee-1a04-4b43-8711-63c9d0f5416a"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:08.990599 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:08.990599 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:23:08.999273 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-4b650356-c649-4ff3-a552-1c03e25af3ec req-dab980a1-c0c1-4347-832e-746d62469368 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:08.999674 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-4b650356-c649-4ff3-a552-1c03e25af3ec req-dab980a1-c0c1-4347-832e-746d62469368 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.016970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-4b650356-c649-4ff3-a552-1c03e25af3ec req-dab980a1-c0c1-4347-832e-746d62469368 service nova] Creating event network-changed:6340c9ee-1a04-4b43-8711-63c9d0f5416a for instance 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef on hv-cinder-80043 Jul 27 15:23:09.021596 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-4b650356-c649-4ff3-a552-1c03e25af3ec req-dab980a1-c0c1-4347-832e-746d62469368 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037837 Jul 27 15:23:09.022381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 134/272] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:09.354963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-034c13b8-8b13-4a9a-95c0-ba77b3a7ce73 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:09.356292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-034c13b8-8b13-4a9a-95c0-ba77b3a7ce73 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:09.362632 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-034c13b8-8b13-4a9a-95c0-ba77b3a7ce73 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.363086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-034c13b8-8b13-4a9a-95c0-ba77b3a7ce73 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.363867 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-034c13b8-8b13-4a9a-95c0-ba77b3a7ce73 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.364301 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-034c13b8-8b13-4a9a-95c0-ba77b3a7ce73 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.427675 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e3a70702-32e1-4b0a-8b96-19d51a84ca9e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:09.428906 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e3a70702-32e1-4b0a-8b96-19d51a84ca9e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:09.435938 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3a70702-32e1-4b0a-8b96-19d51a84ca9e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.436384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3a70702-32e1-4b0a-8b96-19d51a84ca9e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.437625 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3a70702-32e1-4b0a-8b96-19d51a84ca9e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.438297 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e3a70702-32e1-4b0a-8b96-19d51a84ca9e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.857772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-034c13b8-8b13-4a9a-95c0-ba77b3a7ce73 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28627 microversion: 2.1 time: 0.506269 Jul 27 15:23:09.862293 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 139/273] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:09 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28627 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:23:09.866304 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:09.867020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:09.874093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.874954 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.875744 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.876869 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.877559 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e3a70702-32e1-4b0a-8b96-19d51a84ca9e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28195 microversion: 2.20 time: 0.454265 Jul 27 15:23:09.878204 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 135/274] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:09 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28195 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:09.888329 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:09.891165 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:09.900702 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.903689 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:09.904711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:09.905296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:10.106095 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:10.117525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c9d61c0f-bfe6-4857-aaa6-cf8fe1feecbc tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.255462 Jul 27 15:23:10.123148 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 140/275] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:09 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:10.125979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:10.131415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:10.132191 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:10.135992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7c0ba962-04d0-4034-864a-389da00211f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.256170 Jul 27 15:23:10.145375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 136/276] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:09 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:10.149635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:10.150255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:10.151238 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:10.151848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:10.309718 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:10.319932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-17bf3de5-a683-4a5e-abfa-42fa955792ce tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.195338 Jul 27 15:23:10.330517 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 141/277] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:10 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:10.868976 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-15c13145-892e-4cff-8825-ce3a00abf7ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:10.869907 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-15c13145-892e-4cff-8825-ce3a00abf7ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:10.875646 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-15c13145-892e-4cff-8825-ce3a00abf7ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:10.876711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-15c13145-892e-4cff-8825-ce3a00abf7ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:10.877514 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-15c13145-892e-4cff-8825-ce3a00abf7ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:10.877940 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-15c13145-892e-4cff-8825-ce3a00abf7ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:10.890662 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d972ee96-1370-4540-a64d-51ebbed1dcf1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:10.891624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d972ee96-1370-4540-a64d-51ebbed1dcf1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:10.911090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d972ee96-1370-4540-a64d-51ebbed1dcf1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:10.911718 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d972ee96-1370-4540-a64d-51ebbed1dcf1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:10.912484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d972ee96-1370-4540-a64d-51ebbed1dcf1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:10.913075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d972ee96-1370-4540-a64d-51ebbed1dcf1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:11.095789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-15c13145-892e-4cff-8825-ce3a00abf7ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28627 microversion: 2.1 time: 0.229658 Jul 27 15:23:11.096584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 137/278] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:10 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28627 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:11.132766 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d972ee96-1370-4540-a64d-51ebbed1dcf1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28195 microversion: 2.20 time: 0.246224 Jul 27 15:23:11.133648 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 142/279] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:10 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28195 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:11.139259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:11.139993 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:11.147104 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:11.147479 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:11.148341 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:11.148819 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:11.153261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:11.154044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:11.167614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:11.170759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:11.173797 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:11.174392 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:11.596484 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:11.603827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fbf7d3ac-e958-4459-abf3-3ad285bb2227 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.468488 Jul 27 15:23:11.604365 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:11.612604 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ad540a0e-9ead-449f-b7c0-16db1b05300c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1522 microversion: 2.1 time: 0.463221 Jul 27 15:23:11.613306 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 143/280] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:11 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:11.613760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 138/281] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:11 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:11.617771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:11.618408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:11.623933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:11.624382 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:11.625157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:11.625593 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:11.769207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:11.777251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-089c147d-d01d-4d24-b3db-77bf3d01d16a tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.162726 Jul 27 15:23:11.777951 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 144/282] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:11 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:12.107711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6f4cc2b9-94a0-4640-8112-3139c14f9caa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:12.108673 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6f4cc2b9-94a0-4640-8112-3139c14f9caa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:12.114966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2b9-94a0-4640-8112-3139c14f9caa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:12.115393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2b9-94a0-4640-8112-3139c14f9caa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:12.116157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2b9-94a0-4640-8112-3139c14f9caa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:12.116586 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2b9-94a0-4640-8112-3139c14f9caa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:12.144288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6f7c6f9d-4068-4f9e-b7df-b8bf6607627d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:12.145339 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6f7c6f9d-4068-4f9e-b7df-b8bf6607627d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:12.151229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f9d-4068-4f9e-b7df-b8bf6607627d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:12.151678 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f9d-4068-4f9e-b7df-b8bf6607627d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:12.152451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f9d-4068-4f9e-b7df-b8bf6607627d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:12.152884 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f9d-4068-4f9e-b7df-b8bf6607627d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.174936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6f4cc2b9-94a0-4640-8112-3139c14f9caa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28627 microversion: 2.1 time: 3.070699 Jul 27 15:23:15.175982 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 139/283] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:12 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28627 bytes in 3072 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:15.180694 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:15.181331 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:15.187397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.187841 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.188602 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.189035 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.240827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6f7c6f9d-4068-4f9e-b7df-b8bf6607627d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28485 microversion: 2.20 time: 3.099930 Jul 27 15:23:15.241533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 145/284] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:12 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28485 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:15.246742 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:15.247509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:15.253747 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.254271 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.255292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.255916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.361175 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:15.369262 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b5529ed5-5a65-4118-9ebe-fe67127cba6a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.192200 Jul 27 15:23:15.374888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 140/285] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:15 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:15.379862 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:15.380587 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:15.386981 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.387463 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.388371 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.389000 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.437290 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:15.445192 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0311bf96-b22d-496a-86be-69f75b330004 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1502 microversion: 2.1 time: 0.202048 Jul 27 15:23:15.445898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 146/286] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:15 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:15.461899 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:15.462847 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:15.469225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.469372 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.471167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.471611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.581386 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:15.589374 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-633d93f2-74bb-4ba9-896b-d78629d2983b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.218596 Jul 27 15:23:15.590835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 141/287] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:15 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:15.595698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-6bb20afd-9580-40c6-9319-17d0c7928130 req-b341cda4-7d4a-4bb0-8785-c132010e98fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f5caae-fb56-41ed-8695-8b18f89a83d9", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa1e3e-69e0-4fdd-aae2-d048e8f8be3c"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:15.597209 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:15.597209 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:23:15.604368 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-6bb20afd-9580-40c6-9319-17d0c7928130 req-b341cda4-7d4a-4bb0-8785-c132010e98fe service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:15.604803 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-6bb20afd-9580-40c6-9319-17d0c7928130 req-b341cda4-7d4a-4bb0-8785-c132010e98fe service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:15.616464 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-6bb20afd-9580-40c6-9319-17d0c7928130 req-b341cda4-7d4a-4bb0-8785-c132010e98fe service nova] Creating event network-vif-plugged:d2fa1e3e-69e0-4fdd-aae2-d048e8f8be3c for instance 32f5caae-fb56-41ed-8695-8b18f89a83d9 on hv-cinder-80043 Jul 27 15:23:15.622896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-6bb20afd-9580-40c6-9319-17d0c7928130 req-b341cda4-7d4a-4bb0-8785-c132010e98fe service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030625 Jul 27 15:23:15.623698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 142/288] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:15.644060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:15.651298 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cdf3598a-d847-4042-b802-496fc799cbbc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1515 microversion: 2.1 time: 0.193542 Jul 27 15:23:15.651856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 147/289] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:15 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:16.187628 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-147403ce-dfa4-4768-b4cd-45d18631c3f5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:16.189666 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-147403ce-dfa4-4768-b4cd-45d18631c3f5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:16.197004 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-147403ce-dfa4-4768-b4cd-45d18631c3f5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.197970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-147403ce-dfa4-4768-b4cd-45d18631c3f5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.198767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-147403ce-dfa4-4768-b4cd-45d18631c3f5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.199458 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-147403ce-dfa4-4768-b4cd-45d18631c3f5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.251548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3b02e41f-a37e-47de-82a2-3b135f27edf8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:16.252467 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3b02e41f-a37e-47de-82a2-3b135f27edf8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:16.259086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b02e41f-a37e-47de-82a2-3b135f27edf8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.259537 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b02e41f-a37e-47de-82a2-3b135f27edf8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.260503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b02e41f-a37e-47de-82a2-3b135f27edf8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.261100 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b02e41f-a37e-47de-82a2-3b135f27edf8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.507186 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-147403ce-dfa4-4768-b4cd-45d18631c3f5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 28743 microversion: 2.1 time: 0.324055 Jul 27 15:23:16.507829 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 143/290] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:16 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 28743 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:16.512921 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:16.513603 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:16.519990 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.520439 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.521203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.521628 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.525364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3b02e41f-a37e-47de-82a2-3b135f27edf8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28485 microversion: 2.20 time: 0.277347 Jul 27 15:23:16.526007 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 148/291] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:16 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28485 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:16.607404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:16.608093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:16.615079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.615522 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.616281 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:16.616708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:16.688675 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:16.696212 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a1d177c3-443a-4a1b-8ef4-7b75d6f547db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.187094 Jul 27 15:23:16.696971 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 144/292] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:16 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:16.760715 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:16.768249 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-253b3967-f9b2-4b9d-8028-4b496afb7109 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.164891 Jul 27 15:23:16.768800 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 149/293] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:16 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:17.011026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:17.011893 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:17.018212 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.018682 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:17.019437 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.019863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:17.041211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lazy-loading 'flavor' on Instance uuid 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:23:17.148679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-61a6dce3-e235-4e76-bdaf-6fdca5eee676 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action" status: 200 len: 32 microversion: 2.1 time: 0.141356 Jul 27 15:23:17.149352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 145/294] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:17 2021] POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:23:17.158158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:17.158815 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:17.165506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.165984 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:17.167177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.167586 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:17.300680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:17.307766 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d5f37275-fa98-4a8f-8779-b541de0c977d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.153325 Jul 27 15:23:17.308315 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 150/295] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:17 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:17.519966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4c228a46-ac23-45c2-a2b2-52d7c9ec6dda tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:17.520963 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4c228a46-ac23-45c2-a2b2-52d7c9ec6dda tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:17.527679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c228a46-ac23-45c2-a2b2-52d7c9ec6dda tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.528124 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c228a46-ac23-45c2-a2b2-52d7c9ec6dda tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:17.528887 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c228a46-ac23-45c2-a2b2-52d7c9ec6dda tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.529321 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c228a46-ac23-45c2-a2b2-52d7c9ec6dda tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:17.536861 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f78fbc07-c278-4e8f-8694-f7db0d42609d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:17.537770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f78fbc07-c278-4e8f-8694-f7db0d42609d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:17.543527 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f78fbc07-c278-4e8f-8694-f7db0d42609d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.543913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f78fbc07-c278-4e8f-8694-f7db0d42609d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:17.544960 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f78fbc07-c278-4e8f-8694-f7db0d42609d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:17.545402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f78fbc07-c278-4e8f-8694-f7db0d42609d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:20.479108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4c228a46-ac23-45c2-a2b2-52d7c9ec6dda tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 32504 microversion: 2.1 time: 2.963373 Jul 27 15:23:20.480582 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 146/296] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:17 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 32504 bytes in 2965 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:20.485708 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:20.486371 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:20.492540 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:20.492979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:20.493745 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:20.494197 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:20.553861 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f78fbc07-c278-4e8f-8694-f7db0d42609d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 3.020502 Jul 27 15:23:20.554525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 151/297] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:17 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:20.559869 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:20.560431 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:20.568438 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:20.568888 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:20.569664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:20.570094 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:20.674021 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:20.681304 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0a1028fe-ae86-4aeb-9f94-1c1b3a28fa84 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.200105 Jul 27 15:23:20.681950 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 147/298] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:20 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:20.687453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:20.688722 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:20.694345 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:20.694974 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:20.695813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:20.696366 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:20.748180 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:20.755649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a6e522a7-4035-409d-a447-a45ac44820ba tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1318 microversion: 2.1 time: 0.199993 Jul 27 15:23:20.756401 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 152/299] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:20 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:20.843416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:20.851418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-30f31563-8faa-4de0-828b-cbd209dc8f1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.168386 Jul 27 15:23:20.852286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 148/300] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:20 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:21.490764 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-44449d51-1a3d-4921-86ba-50be9e2aa0bd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:21.491706 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-44449d51-1a3d-4921-86ba-50be9e2aa0bd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:21.497469 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44449d51-1a3d-4921-86ba-50be9e2aa0bd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.497911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44449d51-1a3d-4921-86ba-50be9e2aa0bd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.498692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44449d51-1a3d-4921-86ba-50be9e2aa0bd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.499124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44449d51-1a3d-4921-86ba-50be9e2aa0bd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.566160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bc070c24-ecc3-4b6f-a0cd-b4e386fdd8e4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:21.567135 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bc070c24-ecc3-4b6f-a0cd-b4e386fdd8e4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:21.573403 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc070c24-ecc3-4b6f-a0cd-b4e386fdd8e4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.574537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc070c24-ecc3-4b6f-a0cd-b4e386fdd8e4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.575436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc070c24-ecc3-4b6f-a0cd-b4e386fdd8e4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.575869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bc070c24-ecc3-4b6f-a0cd-b4e386fdd8e4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.613230 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-44449d51-1a3d-4921-86ba-50be9e2aa0bd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 33079 microversion: 2.1 time: 0.125615 Jul 27 15:23:21.614269 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 153/301] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:21 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 33079 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:21.673650 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bc070c24-ecc3-4b6f-a0cd-b4e386fdd8e4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.111730 Jul 27 15:23:21.675180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 149/302] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:21 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:21.678506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-39ac0479-e43c-4837-bb82-cd89a75b03c7 req-3688d3af-1192-44c0-bafe-264ce50b6bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef", "name": "network-vif-plugged", "status": "completed", "tag": "6340c9ee-1a04-4b43-8711-63c9d0f5416a"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:21.680055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:21.680055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:23:21.690061 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-39ac0479-e43c-4837-bb82-cd89a75b03c7 req-3688d3af-1192-44c0-bafe-264ce50b6bdd service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.690802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-39ac0479-e43c-4837-bb82-cd89a75b03c7 req-3688d3af-1192-44c0-bafe-264ce50b6bdd service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.700187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:21.700830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:21.712981 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-39ac0479-e43c-4837-bb82-cd89a75b03c7 req-3688d3af-1192-44c0-bafe-264ce50b6bdd service nova] Creating event network-vif-plugged:6340c9ee-1a04-4b43-8711-63c9d0f5416a for instance 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef on hv-cinder-80043 Jul 27 15:23:21.713889 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.714293 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.715362 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.715818 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.720289 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-39ac0479-e43c-4837-bb82-cd89a75b03c7 req-3688d3af-1192-44c0-bafe-264ce50b6bdd service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046640 Jul 27 15:23:21.721791 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 154/303] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:21.775265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:21.776453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:21.784350 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.785018 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.786100 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.786814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.942377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:21.951343 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f3157073-c61e-4e3c-88c9-f2611ae5ebd7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.256000 Jul 27 15:23:21.952011 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 150/304] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:21 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:21.956451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:21.957391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:21.964357 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.965076 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:21.966013 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:21.966552 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:22.002312 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:22.016323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-575fe36b-b702-4881-9a5e-8b08b5e348ff tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1508 microversion: 2.1 time: 0.246158 Jul 27 15:23:22.028291 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 155/305] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:21 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:22.126430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:22.134898 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3f2be696-908e-4cb3-835f-b93f7f47a09a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.181647 Jul 27 15:23:22.136042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 151/306] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:21 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:22.624981 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-35a6a6a7-bc6a-40d5-a3f1-07c360d70ddc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:22.625802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-35a6a6a7-bc6a-40d5-a3f1-07c360d70ddc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:22.631532 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a6a6a7-bc6a-40d5-a3f1-07c360d70ddc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:22.631974 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a6a6a7-bc6a-40d5-a3f1-07c360d70ddc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:22.632719 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a6a6a7-bc6a-40d5-a3f1-07c360d70ddc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:22.633180 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a6a6a7-bc6a-40d5-a3f1-07c360d70ddc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:22.685299 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-92333745-5d5a-401d-90c2-3bf067d132ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:22.686253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-92333745-5d5a-401d-90c2-3bf067d132ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:22.691926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92333745-5d5a-401d-90c2-3bf067d132ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:22.692364 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92333745-5d5a-401d-90c2-3bf067d132ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:22.693113 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92333745-5d5a-401d-90c2-3bf067d132ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:22.693537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92333745-5d5a-401d-90c2-3bf067d132ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:22.796682 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-35a6a6a7-bc6a-40d5-a3f1-07c360d70ddc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 33592 microversion: 2.1 time: 0.175287 Jul 27 15:23:22.797356 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 156/307] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:22 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 33592 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:22.866145 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-92333745-5d5a-401d-90c2-3bf067d132ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.184312 Jul 27 15:23:22.866816 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 152/308] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:22 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:22.968352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:22.969038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:22.976060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:22.976523 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:22.977275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:22.977702 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.113155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:23.120495 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9fd674c3-2f60-4075-8b61-9c7f4e5bedad tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.156114 Jul 27 15:23:23.121056 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 157/309] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:22 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:23.152402 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:23.153094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:23.159449 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.159891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.160652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.161079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.306240 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:23.314110 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-004e0817-dd59-4154-8649-b5ead48c16ab tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.165634 Jul 27 15:23:23.314706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 153/310] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:23 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:23.360633 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-367c1ef2-ec8d-4f98-ae20-5a56e080436e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98cf56c7-208b-4af3-b5c9-d60c7270c40b"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:23.361755 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-367c1ef2-ec8d-4f98-ae20-5a56e080436e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:23.367480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1ef2-ec8d-4f98-ae20-5a56e080436e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.367916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1ef2-ec8d-4f98-ae20-5a56e080436e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.368660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1ef2-ec8d-4f98-ae20-5a56e080436e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.369088 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1ef2-ec8d-4f98-ae20-5a56e080436e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.646271 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-367c1ef2-ec8d-4f98-ae20-5a56e080436e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289835 Jul 27 15:23:23.647012 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 158/311] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:23:23 2021] POST /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:23.808753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4e21b4c4-0ed5-4e93-a034-887dd2571842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:23.809698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4e21b4c4-0ed5-4e93-a034-887dd2571842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:23.815783 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e21b4c4-0ed5-4e93-a034-887dd2571842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.816219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e21b4c4-0ed5-4e93-a034-887dd2571842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.817123 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e21b4c4-0ed5-4e93-a034-887dd2571842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.817636 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4e21b4c4-0ed5-4e93-a034-887dd2571842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.877440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f23b6f4e-1c33-4c5f-8492-60d811092aab tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:23.878549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f23b6f4e-1c33-4c5f-8492-60d811092aab tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:23.884527 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f23b6f4e-1c33-4c5f-8492-60d811092aab tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.884965 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f23b6f4e-1c33-4c5f-8492-60d811092aab tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:23.885720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f23b6f4e-1c33-4c5f-8492-60d811092aab tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:23.886149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f23b6f4e-1c33-4c5f-8492-60d811092aab tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:24.009781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4e21b4c4-0ed5-4e93-a034-887dd2571842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 33886 microversion: 2.1 time: 0.204993 Jul 27 15:23:24.010451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 154/312] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:23 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 33886 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:24.139222 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:24.139914 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:24.147211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:24.147652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:24.148421 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:24.148839 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:24.191698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f23b6f4e-1c33-4c5f-8492-60d811092aab tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.318059 Jul 27 15:23:24.192624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 159/313] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:23 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:24.281024 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:24.289037 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a740a16c-d2b0-4f1c-ae20-6e6940b0fdb1 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1497 microversion: 2.1 time: 0.154535 Jul 27 15:23:24.289588 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 155/314] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:24 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:24.331517 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:24.332228 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:24.339434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:24.339896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:24.340683 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:24.341136 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:24.475232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:24.482325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-54f87ed3-a637-46f3-aa4c-ca7c997bc4f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.155440 Jul 27 15:23:24.482915 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 160/315] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:24 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:25.021505 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d328f547-ca84-4a9d-ad8c-4de78b3e0156 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:25.022481 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d328f547-ca84-4a9d-ad8c-4de78b3e0156 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:25.028772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d328f547-ca84-4a9d-ad8c-4de78b3e0156 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.029267 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d328f547-ca84-4a9d-ad8c-4de78b3e0156 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.030367 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d328f547-ca84-4a9d-ad8c-4de78b3e0156 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.030845 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d328f547-ca84-4a9d-ad8c-4de78b3e0156 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.187640 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d328f547-ca84-4a9d-ad8c-4de78b3e0156 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 34384 microversion: 2.1 time: 0.170046 Jul 27 15:23:25.188851 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 156/316] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:25 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 34384 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:25.203454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2d762026-b6db-48e9-b3f3-cdb2b4ae1b8e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:25.204464 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2d762026-b6db-48e9-b3f3-cdb2b4ae1b8e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:25.211158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2d762026-b6db-48e9-b3f3-cdb2b4ae1b8e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.211618 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2d762026-b6db-48e9-b3f3-cdb2b4ae1b8e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.212920 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2d762026-b6db-48e9-b3f3-cdb2b4ae1b8e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.213403 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2d762026-b6db-48e9-b3f3-cdb2b4ae1b8e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.384891 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2d762026-b6db-48e9-b3f3-cdb2b4ae1b8e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.184963 Jul 27 15:23:25.385657 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 161/317] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:25 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:25.389007 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:25.389824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:25.396904 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.397581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.398616 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.399261 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.436497 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:23:25.500693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:25.501471 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:25.508370 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.511998 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.512986 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.513558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.542004 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f3addd04-2a65-4f6b-bf49-b7b8633327d4 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "DELETE /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 204 len: 0 microversion: 2.1 time: 0.156103 Jul 27 15:23:25.542969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 157/318] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:23:25 2021] DELETE /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:23:25.553224 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:25.554632 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:25.572043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.572496 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.573313 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:25.574682 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:25.712609 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:25.728736 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9c24ba2d-4d0f-4830-ba95-340b5dbef56a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.229087 Jul 27 15:23:25.730053 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 162/319] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:25 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:25.776106 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:25.785884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b78b28cf-80ac-488c-b626-25bcab4e2f5d tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1503 microversion: 2.1 time: 0.238539 Jul 27 15:23:25.786565 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 158/320] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:25 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:26.200631 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-89c676dd-492b-4c1b-afc7-2d9fb4248895 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:26.201612 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-89c676dd-492b-4c1b-afc7-2d9fb4248895 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:26.209043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-89c676dd-492b-4c1b-afc7-2d9fb4248895 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.209043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-89c676dd-492b-4c1b-afc7-2d9fb4248895 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.209726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-89c676dd-492b-4c1b-afc7-2d9fb4248895 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.209989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-89c676dd-492b-4c1b-afc7-2d9fb4248895 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.343613 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-89c676dd-492b-4c1b-afc7-2d9fb4248895 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 34839 microversion: 2.1 time: 0.147011 Jul 27 15:23:26.344457 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 163/321] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:26 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 34839 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:23:26.397433 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0df2da38-ac8d-4656-aeb4-555539fa6bbb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:26.398455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0df2da38-ac8d-4656-aeb4-555539fa6bbb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:26.405090 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df2da38-ac8d-4656-aeb4-555539fa6bbb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.405629 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df2da38-ac8d-4656-aeb4-555539fa6bbb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.406535 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df2da38-ac8d-4656-aeb4-555539fa6bbb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.407662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df2da38-ac8d-4656-aeb4-555539fa6bbb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.561439 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0df2da38-ac8d-4656-aeb4-555539fa6bbb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.167959 Jul 27 15:23:26.562260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 159/322] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:26 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:26.746094 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:26.746784 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:26.755744 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.756499 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.757853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.758223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.805488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:26.806433 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:26.813849 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.814630 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.815852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:26.816291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:26.960179 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:26.968995 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2de9ce5e-3cf4-4eed-a44b-e0b8ad73698e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.227406 Jul 27 15:23:26.971158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 164/323] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:26 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:27.014716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:27.022551 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-aad688fb-7072-4aaa-bb26-505abb3e4674 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1503 microversion: 2.1 time: 0.222456 Jul 27 15:23:27.023408 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 160/324] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:26 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:27.356026 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-94819e0e-1f00-40ef-9efe-af547bd29813 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:27.356940 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-94819e0e-1f00-40ef-9efe-af547bd29813 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:27.363061 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94819e0e-1f00-40ef-9efe-af547bd29813 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:27.363569 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94819e0e-1f00-40ef-9efe-af547bd29813 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:27.364534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94819e0e-1f00-40ef-9efe-af547bd29813 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:27.365032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94819e0e-1f00-40ef-9efe-af547bd29813 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:27.473755 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-94819e0e-1f00-40ef-9efe-af547bd29813 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 36623 microversion: 2.1 time: 0.121903 Jul 27 15:23:27.475480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 165/325] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:27 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 36623 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:27.573821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-90c3c432-9701-4b4c-94b2-22588c91afc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:27.574957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-90c3c432-9701-4b4c-94b2-22588c91afc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:27.581581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90c3c432-9701-4b4c-94b2-22588c91afc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:27.582339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90c3c432-9701-4b4c-94b2-22588c91afc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:27.583515 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90c3c432-9701-4b4c-94b2-22588c91afc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:27.584147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90c3c432-9701-4b4c-94b2-22588c91afc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:27.765043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-90c3c432-9701-4b4c-94b2-22588c91afc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.195194 Jul 27 15:23:27.767587 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 161/326] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:27 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:27.990396 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:27.991391 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:27.998377 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:27.999149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.000152 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.001379 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.041440 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:28.042363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:28.056328 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.057097 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.058086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.058766 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.338211 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:28.349228 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-494b89a8-5a24-409d-90e3-e6c9467beb1d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.365396 Jul 27 15:23:28.351342 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 166/327] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:27 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:28.391396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:28.401173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-79f9bdbd-0ac3-4709-9abd-0158b90959f9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1503 microversion: 2.1 time: 0.364649 Jul 27 15:23:28.402298 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 162/328] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:28 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:28.493704 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7d36cca2-8cc9-48d2-8053-94edb043082e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:28.494664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7d36cca2-8cc9-48d2-8053-94edb043082e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:28.501003 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d36cca2-8cc9-48d2-8053-94edb043082e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.505983 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d36cca2-8cc9-48d2-8053-94edb043082e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.507044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d36cca2-8cc9-48d2-8053-94edb043082e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.507840 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d36cca2-8cc9-48d2-8053-94edb043082e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.638201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7d36cca2-8cc9-48d2-8053-94edb043082e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 37270 microversion: 2.1 time: 0.152104 Jul 27 15:23:28.639292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 167/329] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:28 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 37270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:23:28.772007 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-136469b9-6506-4e46-8c40-a0f71f5cd7ad req-12a130d4-aaf7-4fbf-9994-5a3bd877b72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef", "name": "network-vif-deleted", "tag": "6340c9ee-1a04-4b43-8711-63c9d0f5416a"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:28.774146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:28.774146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:23:28.777517 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-223f187b-70a6-45cf-a9ec-ab31b8f23791 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:28.780774 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-223f187b-70a6-45cf-a9ec-ab31b8f23791 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:28.780996 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-136469b9-6506-4e46-8c40-a0f71f5cd7ad req-12a130d4-aaf7-4fbf-9994-5a3bd877b72b service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.781444 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-136469b9-6506-4e46-8c40-a0f71f5cd7ad req-12a130d4-aaf7-4fbf-9994-5a3bd877b72b service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.792337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-223f187b-70a6-45cf-a9ec-ab31b8f23791 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.792782 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-223f187b-70a6-45cf-a9ec-ab31b8f23791 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.793554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-223f187b-70a6-45cf-a9ec-ab31b8f23791 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:28.793979 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-223f187b-70a6-45cf-a9ec-ab31b8f23791 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:28.797850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-136469b9-6506-4e46-8c40-a0f71f5cd7ad req-12a130d4-aaf7-4fbf-9994-5a3bd877b72b service nova] Creating event network-vif-deleted:6340c9ee-1a04-4b43-8711-63c9d0f5416a for instance 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef on hv-cinder-80043 Jul 27 15:23:28.802670 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-136469b9-6506-4e46-8c40-a0f71f5cd7ad req-12a130d4-aaf7-4fbf-9994-5a3bd877b72b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034277 Jul 27 15:23:28.803523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 163/330] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:28.941943 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-223f187b-70a6-45cf-a9ec-ab31b8f23791 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.168210 Jul 27 15:23:28.946724 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 168/331] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:28 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:29.368735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:29.369564 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:29.376155 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.376705 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.377563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.378066 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.420101 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:29.421039 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:29.427938 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.428599 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.429557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.430145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.467520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.468027 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.469507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lazy-loading 'fault' on Instance uuid 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:23:29.565961 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:29.579842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:29.582291 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-93d6067d-b1e6-4e3e-bfaa-2cbdded63212 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 200 len: 1304 microversion: 2.1 time: 0.166608 Jul 27 15:23:29.588206 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-33be5e0f-f74c-4598-90e5-cc921224fbf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.223875 Jul 27 15:23:29.593186 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 169/332] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:29 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:29.595112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 164/333] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:29 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:29.650197 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fdcef255-8a0f-4325-87d5-a6095ba7b2e5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:29.651152 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fdcef255-8a0f-4325-87d5-a6095ba7b2e5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:29.657451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcef255-8a0f-4325-87d5-a6095ba7b2e5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.657885 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcef255-8a0f-4325-87d5-a6095ba7b2e5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.658886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcef255-8a0f-4325-87d5-a6095ba7b2e5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.659409 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcef255-8a0f-4325-87d5-a6095ba7b2e5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.672781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1758032686", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "dda8cb76-48cd-4061-9465-3f02fa986cfd"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:29.727268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] validate_networks() for [('dda8cb76-48cd-4061-9465-3f02fa986cfd', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:23:29.781096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fdcef255-8a0f-4325-87d5-a6095ba7b2e5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 37918 microversion: 2.1 time: 0.134402 Jul 27 15:23:29.782310 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 170/334] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:29 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 37918 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:29.953915 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-de957c2b-51f9-4df3-b907-cc7d22283bfd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:29.954932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-de957c2b-51f9-4df3-b907-cc7d22283bfd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:29.961417 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de957c2b-51f9-4df3-b907-cc7d22283bfd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.961865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de957c2b-51f9-4df3-b907-cc7d22283bfd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:29.962662 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de957c2b-51f9-4df3-b907-cc7d22283bfd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:29.963253 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de957c2b-51f9-4df3-b907-cc7d22283bfd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.064789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-de957c2b-51f9-4df3-b907-cc7d22283bfd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.114045 Jul 27 15:23:30.068906 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 171/335] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:29 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:30.076955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:23:30.077414 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:23:30.077872 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:23:30.078279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:23:30.078745 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:23:30.087768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.088303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.089144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.089577 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.108381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Getting quotas for project cb8f75cbd1734c8badbc060217f7bc9d. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:23:30.112992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Getting quotas for user c35a7e69518f46ff9077527e4d810687 and project cb8f75cbd1734c8badbc060217f7bc9d. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:23:30.124134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:23:30.126667 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:23:30.170843 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3fd62fda-337f-46fa-842c-10ed3cdf8e70 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502544 Jul 27 15:23:30.171650 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 165/336] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:23:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:23:30.182640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0a98b04c-29ee-45f3-939b-f3eefc8b0051 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:30.183479 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0a98b04c-29ee-45f3-939b-f3eefc8b0051 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:30.241301 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0a98b04c-29ee-45f3-939b-f3eefc8b0051 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:30.248117 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0a98b04c-29ee-45f3-939b-f3eefc8b0051 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1219 microversion: 2.1 time: 0.070240 Jul 27 15:23:30.248830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 172/337] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:30 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:30.600180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:30.600798 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:30.604670 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:30.606646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:30.606850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.607291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.608060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.608499 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.624378 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] HTTP exception thrown: Instance 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef could not be found. Jul 27 15:23:30.624980 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Returning 404 to user: Instance 7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:23:30.625846 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-433586ea-615f-4209-a490-4d73cb48ceff tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef" status: 404 len: 111 microversion: 2.1 time: 0.029724 Jul 27 15:23:30.626392 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 166/338] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:30 2021] GET /compute/v2.1/servers/7ee33dd2-43b8-4abb-aa64-797f7a2dd7ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:23:30.641827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.642275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.643263 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.643733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.728259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2015657086", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "0022a182-af30-461d-881d-a8e0230ebcce"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:30.797064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] validate_networks() for [('0022a182-af30-461d-881d-a8e0230ebcce', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:23:30.797928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:30.805320 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-113df77e-f6a4-4a71-8f52-fe4c0f913e1c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.204812 Jul 27 15:23:30.805881 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 173/339] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:30 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:30.810719 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b215c491-63da-45a9-ab0b-9b944fa063a7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:30.811838 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b215c491-63da-45a9-ab0b-9b944fa063a7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:30.818117 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b215c491-63da-45a9-ab0b-9b944fa063a7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.818957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b215c491-63da-45a9-ab0b-9b944fa063a7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.819752 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b215c491-63da-45a9-ab0b-9b944fa063a7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:30.820183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b215c491-63da-45a9-ab0b-9b944fa063a7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:30.938381 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b215c491-63da-45a9-ab0b-9b944fa063a7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 38077 microversion: 2.1 time: 0.131049 Jul 27 15:23:30.939580 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 174/340] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:30 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 38077 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:31.077384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-99973e1b-972f-4921-ab83-04b1f9dc314c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:31.078817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-99973e1b-972f-4921-ab83-04b1f9dc314c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:31.085279 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-99973e1b-972f-4921-ab83-04b1f9dc314c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.085729 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-99973e1b-972f-4921-ab83-04b1f9dc314c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.086514 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-99973e1b-972f-4921-ab83-04b1f9dc314c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.086952 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-99973e1b-972f-4921-ab83-04b1f9dc314c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.137511 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:23:31.137980 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:23:31.138369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:23:31.138802 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:23:31.139205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:23:31.148018 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.148454 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.149245 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.149670 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.165637 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Getting quotas for project 60eedbf75f734b36b60ba0bf2bea7123. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:23:31.169489 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Getting quotas for user 2424381d2fde4c47a559a821f327ac4a and project 60eedbf75f734b36b60ba0bf2bea7123. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:23:31.180464 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:23:31.182598 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:23:31.210364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-99973e1b-972f-4921-ab83-04b1f9dc314c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28651 microversion: 2.20 time: 0.137170 Jul 27 15:23:31.211179 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 175/341] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:31 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28651 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:31.229707 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-03ed8a82-d8d7-477c-8500-1dc0aca8f67c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505241 Jul 27 15:23:31.230343 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 167/342] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:23:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:23:31.241303 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-65ed4c6c-5eb2-47ad-aae8-65ceaf801743 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:31.242180 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-65ed4c6c-5eb2-47ad-aae8-65ceaf801743 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:31.264845 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:31.265553 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:31.272314 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.272974 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.273929 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.274535 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.320010 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-65ed4c6c-5eb2-47ad-aae8-65ceaf801743 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:31.327253 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-65ed4c6c-5eb2-47ad-aae8-65ceaf801743 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1214 microversion: 2.1 time: 0.090785 Jul 27 15:23:31.329534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 176/343] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:31 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:31.353081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:31.360548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8bde7259-6bd6-48ed-9521-ce66f1dd2d1f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1271 microversion: 2.1 time: 0.099281 Jul 27 15:23:31.361193 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 168/344] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:31 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:31.823176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:31.824439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:31.836856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.837677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.839108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.840356 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.950096 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1a2dbdfb-0a40-4433-827b-f5496c687058 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:31.951135 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1a2dbdfb-0a40-4433-827b-f5496c687058 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:31.958168 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1a2dbdfb-0a40-4433-827b-f5496c687058 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.958654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1a2dbdfb-0a40-4433-827b-f5496c687058 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:31.959493 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1a2dbdfb-0a40-4433-827b-f5496c687058 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:31.959961 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1a2dbdfb-0a40-4433-827b-f5496c687058 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.030989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:32.039132 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4fbaad23-174e-4756-9de1-0994c0833a41 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.221159 Jul 27 15:23:32.039720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 177/345] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:31 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:32.107154 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1a2dbdfb-0a40-4433-827b-f5496c687058 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 38077 microversion: 2.1 time: 0.160411 Jul 27 15:23:32.107797 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 169/346] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:31 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 38077 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:23:32.224256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5634f755-e8ac-489e-b7d5-3c431d0f2f3c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:32.225548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5634f755-e8ac-489e-b7d5-3c431d0f2f3c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:32.231735 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5634f755-e8ac-489e-b7d5-3c431d0f2f3c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.232175 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5634f755-e8ac-489e-b7d5-3c431d0f2f3c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.232971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5634f755-e8ac-489e-b7d5-3c431d0f2f3c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.233400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5634f755-e8ac-489e-b7d5-3c431d0f2f3c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.346001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:32.346844 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:32.353360 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.353801 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.354593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.355025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.364722 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5634f755-e8ac-489e-b7d5-3c431d0f2f3c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 28770 microversion: 2.20 time: 0.146058 Jul 27 15:23:32.365468 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 178/347] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:32 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 28770 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:32.378355 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:32.379250 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:32.385703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.386216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.387272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.388026 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.425430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:32.433600 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-69a51319-482d-45d7-83d5-0f2113efa25c tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1266 microversion: 2.1 time: 0.092022 Jul 27 15:23:32.434384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 170/348] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:32 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:32.534767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98cf56c7-208b-4af3-b5c9-d60c7270c40b"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:32.536072 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:32.542153 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.542869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.543642 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.544325 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.561698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:32.573304 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9c5465e8-5654-489e-a9a2-d48d6862817d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.198924 Jul 27 15:23:32.583804 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 179/349] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:32 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:32.633811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] HTTP exception thrown: Invalid volume: volume 98cf56c7-208b-4af3-b5c9-d60c7270c40b is already attached to instances: 32f5caae-fb56-41ed-8695-8b18f89a83d9 Jul 27 15:23:32.634753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Returning 400 to user: Invalid volume: volume 98cf56c7-208b-4af3-b5c9-d60c7270c40b is already attached to instances: 32f5caae-fb56-41ed-8695-8b18f89a83d9 {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:23:32.636029 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4acc9592-2352-4cba-a439-12f309d54d2b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106537 Jul 27 15:23:32.640319 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 171/350] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:23:32 2021] POST /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:23:32.706261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:32.706708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:32.712558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.713009 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.713783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:32.714224 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:32.801492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lazy-loading 'services' on Instance uuid 32f5caae-fb56-41ed-8695-8b18f89a83d9 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:23:32.866139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9456aa9f-45f8-4e14-8fae-2305fa344bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "DELETE /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9/os-volume_attachments/98cf56c7-208b-4af3-b5c9-d60c7270c40b" status: 202 len: 0 microversion: 2.1 time: 0.163640 Jul 27 15:23:32.869990 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 180/351] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:23:32 2021] DELETE /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9/os-volume_attachments/98cf56c7-208b-4af3-b5c9-d60c7270c40b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:33.056774 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:33.057381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:33.063147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.063584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.064568 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.065188 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.120371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-26bda1c6-e937-4a07-8ab5-2543d053ce51 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:33.121594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-26bda1c6-e937-4a07-8ab5-2543d053ce51 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:33.127918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26bda1c6-e937-4a07-8ab5-2543d053ce51 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.128490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26bda1c6-e937-4a07-8ab5-2543d053ce51 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.129320 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26bda1c6-e937-4a07-8ab5-2543d053ce51 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.129735 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26bda1c6-e937-4a07-8ab5-2543d053ce51 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.243712 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-26bda1c6-e937-4a07-8ab5-2543d053ce51 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 38077 microversion: 2.1 time: 0.127186 Jul 27 15:23:33.245068 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 181/352] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:33 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 38077 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:23:33.266496 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:33.274888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e35d667f-d308-48f9-a527-b20e6d89c8ae tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.221959 Jul 27 15:23:33.275678 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 172/353] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:33 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:33.377193 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-264f5e6b-c1a6-4a34-84a0-cf876b86d47f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:33.378177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-264f5e6b-c1a6-4a34-84a0-cf876b86d47f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:33.384555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-264f5e6b-c1a6-4a34-84a0-cf876b86d47f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.384994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-264f5e6b-c1a6-4a34-84a0-cf876b86d47f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.385758 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-264f5e6b-c1a6-4a34-84a0-cf876b86d47f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.386188 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-264f5e6b-c1a6-4a34-84a0-cf876b86d47f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.450811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:33.451418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:33.458149 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.458636 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.459401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.459830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.526408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-264f5e6b-c1a6-4a34-84a0-cf876b86d47f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 29983 microversion: 2.20 time: 0.153172 Jul 27 15:23:33.527350 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 182/354] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:33 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 29983 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:33.529782 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:33.537821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-18897e57-ee81-40a3-8649-a5db01f91208 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1272 microversion: 2.1 time: 0.090630 Jul 27 15:23:33.538380 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 173/355] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:33 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:33.591554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:33.592381 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:33.599163 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.599688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.600523 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.601026 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.642564 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-18e10a29-f6fc-410c-80cd-c35eb41ad5ac req-7deafb3c-a533-4e07-90d6-15029d60b9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9426eb11-80ee-4899-96d9-879ff00e4ca8", "tag": "b9a1824d-7a50-4376-9725-44dcdb38f530"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:33.644369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:33.644369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:23:33.652428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-18e10a29-f6fc-410c-80cd-c35eb41ad5ac req-7deafb3c-a533-4e07-90d6-15029d60b9a1 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:33.652607 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-18e10a29-f6fc-410c-80cd-c35eb41ad5ac req-7deafb3c-a533-4e07-90d6-15029d60b9a1 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:33.666023 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-18e10a29-f6fc-410c-80cd-c35eb41ad5ac req-7deafb3c-a533-4e07-90d6-15029d60b9a1 service nova] Creating event network-changed:b9a1824d-7a50-4376-9725-44dcdb38f530 for instance 9426eb11-80ee-4899-96d9-879ff00e4ca8 on hv-cinder-80043 Jul 27 15:23:33.673344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-18e10a29-f6fc-410c-80cd-c35eb41ad5ac req-7deafb3c-a533-4e07-90d6-15029d60b9a1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034460 Jul 27 15:23:33.675388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 174/356] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:23:33.761217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:33.769118 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c49c6b76-7e64-4c98-8fc6-25bcc27647b3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.181540 Jul 27 15:23:33.769853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 183/357] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:33 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:34.256370 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2a2681ab-ab32-427f-b8fc-83a5b211064c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:34.257415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2a2681ab-ab32-427f-b8fc-83a5b211064c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:34.267985 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a2681ab-ab32-427f-b8fc-83a5b211064c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.268433 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a2681ab-ab32-427f-b8fc-83a5b211064c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.269230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a2681ab-ab32-427f-b8fc-83a5b211064c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.269657 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a2681ab-ab32-427f-b8fc-83a5b211064c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.291612 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:34.292219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:34.301299 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.302000 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.303244 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.304279 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.389170 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2a2681ab-ab32-427f-b8fc-83a5b211064c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 38094 microversion: 2.1 time: 0.136144 Jul 27 15:23:34.394460 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 175/358] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:34 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 38094 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:34.471222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:34.481348 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a3af7e4d-2821-4b68-8165-12f97af62bc4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.192849 Jul 27 15:23:34.483497 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 184/359] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:34 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:34.539047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f9db733c-dc18-47a6-97fe-11517771a9fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:34.540093 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f9db733c-dc18-47a6-97fe-11517771a9fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:34.547063 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9db733c-dc18-47a6-97fe-11517771a9fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.548040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9db733c-dc18-47a6-97fe-11517771a9fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.548743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9db733c-dc18-47a6-97fe-11517771a9fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.549361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f9db733c-dc18-47a6-97fe-11517771a9fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.555314 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:34.556104 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:34.565222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.565662 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.566424 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.566879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.765151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:34.774157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-98b8816e-e897-4add-8d7e-14511faaad53 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.222343 Jul 27 15:23:34.776839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 185/360] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:34 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:34.786454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:34.787229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:34.793337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.793780 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.794840 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:34.795273 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:34.850173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f9db733c-dc18-47a6-97fe-11517771a9fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 31688 microversion: 2.20 time: 0.314999 Jul 27 15:23:34.854770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 176/361] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:34 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 31688 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:34.955898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:34.963143 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a00f3e70-b506-465c-a4a5-78f3bb64baef tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.181268 Jul 27 15:23:34.963697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 186/362] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:34 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:35.163905 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-299816715", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "e7f2813b-6649-45a6-b769-67fc889c519f"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:35.233147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] validate_networks() for [('e7f2813b-6649-45a6-b769-67fc889c519f', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:23:35.401853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6bb05611-d42a-4424-bd72-ed5f80793aeb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:35.403090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6bb05611-d42a-4424-bd72-ed5f80793aeb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:35.409987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bb05611-d42a-4424-bd72-ed5f80793aeb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.410713 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bb05611-d42a-4424-bd72-ed5f80793aeb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.412126 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bb05611-d42a-4424-bd72-ed5f80793aeb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.412798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6bb05611-d42a-4424-bd72-ed5f80793aeb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.588851 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6bb05611-d42a-4424-bd72-ed5f80793aeb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 200 len: 38207 microversion: 2.1 time: 0.191100 Jul 27 15:23:35.594345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 187/363] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:35 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 38207 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:35.598757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:35.599488 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:35.607107 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.607870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.608660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.609090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.684790 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:23:35.685281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:23:35.685789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:23:35.686709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:23:35.687191 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:23:35.698137 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.698638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.699699 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.700300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.717713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:23:35.722309 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Getting quotas for user 7b825ab5c9074d2891ef14d3ee406e03 and project a6fe5cc0565843be92954f7f00c961c9. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:23:35.736581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:23:35.738976 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:23:35.767369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:35.775008 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-64b8d12d-dee6-4403-8c5b-a8ecc2929495 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.184327 Jul 27 15:23:35.775823 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 188/364] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:35 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:35.780383 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-39fc869f-4607-430e-a400-7b5072bfdf46 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:35.781034 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-39fc869f-4607-430e-a400-7b5072bfdf46 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:35.787534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-39fc869f-4607-430e-a400-7b5072bfdf46 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.788234 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-39fc869f-4607-430e-a400-7b5072bfdf46 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.789167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-39fc869f-4607-430e-a400-7b5072bfdf46 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.789611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-39fc869f-4607-430e-a400-7b5072bfdf46 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.794975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c78dcf6f-fdda-4502-8740-2ca8b7ef1233 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633903 Jul 27 15:23:35.795799 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 177/365] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:23:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:23:35.804204 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-c33236a9-ec39-44b3-ad56-f95ec67ffe41 req-f25e024f-af27-4919-96fa-c9c74f946f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "075979c8-2724-4c53-a8c0-e92a5c68afaa", "tag": "0e446813-c2b6-4efe-993c-8e2a76687d55"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:35.805989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:35.805989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:23:35.815236 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-c33236a9-ec39-44b3-ad56-f95ec67ffe41 req-f25e024f-af27-4919-96fa-c9c74f946f2c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.815881 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-c33236a9-ec39-44b3-ad56-f95ec67ffe41 req-f25e024f-af27-4919-96fa-c9c74f946f2c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.824503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-39fc869f-4607-430e-a400-7b5072bfdf46 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/ips" status: 200 len: 146 microversion: 2.1 time: 0.047335 Jul 27 15:23:35.825716 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 189/366] 10.222.0.37 () {58 vars in 1248 bytes} [Tue Jul 27 15:23:35 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:35.830202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:35.830841 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:35.840812 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-c33236a9-ec39-44b3-ad56-f95ec67ffe41 req-f25e024f-af27-4919-96fa-c9c74f946f2c service nova] Creating event network-changed:0e446813-c2b6-4efe-993c-8e2a76687d55 for instance 075979c8-2724-4c53-a8c0-e92a5c68afaa on hv-cinder-80043 Jul 27 15:23:35.846936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-c33236a9-ec39-44b3-ad56-f95ec67ffe41 req-f25e024f-af27-4919-96fa-c9c74f946f2c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047204 Jul 27 15:23:35.848009 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 178/367] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:35.852439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.852895 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.853837 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.854333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.855789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-121899d3-4ae1-4937-85d4-45edd8b5c0f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:35.856762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-121899d3-4ae1-4937-85d4-45edd8b5c0f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:35.937537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-121899d3-4ae1-4937-85d4-45edd8b5c0f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:35.947137 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-121899d3-4ae1-4937-85d4-45edd8b5c0f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1217 microversion: 2.1 time: 0.097305 Jul 27 15:23:35.947805 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 179/368] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:35 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:35.957693 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-692b8547-734a-4891-98f4-63dee6d87796 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:35.958645 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-692b8547-734a-4891-98f4-63dee6d87796 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:35.965091 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-692b8547-734a-4891-98f4-63dee6d87796 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.965601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-692b8547-734a-4891-98f4-63dee6d87796 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:35.966382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-692b8547-734a-4891-98f4-63dee6d87796 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:35.966886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-692b8547-734a-4891-98f4-63dee6d87796 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:36.052764 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:36.059936 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2ccdc0e3-80c5-49c9-826f-0b7d6845c6db tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.233286 Jul 27 15:23:36.060500 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 190/369] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:35 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:36.065352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:36.065960 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:36.071695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:36.072123 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:36.072928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:36.073344 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:36.195672 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-692b8547-734a-4891-98f4-63dee6d87796 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 32946 microversion: 2.20 time: 0.241885 Jul 27 15:23:36.196397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 180/370] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:35 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 32946 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:36.230116 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:36.240187 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a97bafb6-e05e-47fa-860d-49b75639b92c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.178685 Jul 27 15:23:36.240852 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 191/371] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:36 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:36.792561 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:36.793174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:36.800002 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:36.800458 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:36.801227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:36.801744 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:36.940444 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:36.947774 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a2e5c02c-9e85-4cd7-a505-039a69b0a6f4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.159379 Jul 27 15:23:36.948489 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 181/372] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:36 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:36.965235 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:36.965976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:36.972946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:36.973396 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:36.974183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:36.974657 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:37.046078 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:37.053750 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fc32320b-c336-4656-80e8-e55d078b6506 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1269 microversion: 2.1 time: 0.092363 Jul 27 15:23:37.054311 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 192/373] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:36 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:37.076941 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:37.077557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:37.083443 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:37.083898 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:37.084668 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:37.085103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:37.208623 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5a541ebb-68b6-4593-9ce3-215913d91dfb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:37.209910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5a541ebb-68b6-4593-9ce3-215913d91dfb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:37.216104 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5a541ebb-68b6-4593-9ce3-215913d91dfb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:37.216914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5a541ebb-68b6-4593-9ce3-215913d91dfb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:37.232840 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5a541ebb-68b6-4593-9ce3-215913d91dfb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:37.234480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5a541ebb-68b6-4593-9ce3-215913d91dfb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:37.255474 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:37.263638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a147870f-4708-4bda-9b79-8f20af3974f8 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.190313 Jul 27 15:23:37.264200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 182/374] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:37 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:37.269440 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:37.270051 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:37.277286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:37.277773 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:37.278576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:37.279014 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:37.402457 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5a541ebb-68b6-4593-9ce3-215913d91dfb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 33251 microversion: 2.20 time: 0.197600 Jul 27 15:23:37.403736 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 193/375] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:37 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 33251 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:37.433714 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:37.443548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b22759b0-1aed-4013-a1b9-3f7a84fe90ba tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.178057 Jul 27 15:23:37.444121 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 183/376] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:37 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:38.002918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:38.005151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:38.012955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.013404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.014198 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.014661 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.071666 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:38.072353 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:38.087729 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.088348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.089382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.089921 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.272043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:38.283482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-81060c80-5c3f-4d11-8528-796a4eaa83a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.286031 Jul 27 15:23:38.284608 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 194/377] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:37 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:38.292636 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:38.296106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:38.301079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-816ed47d-c863-40b0-9b35-eb63e1e83f5d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.233535 Jul 27 15:23:38.301781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 184/378] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:38 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:38.302351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:38.308452 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.308900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.309674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.310105 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.413831 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-28f45a35-22d0-481b-87b5-1a2002d4de7f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:38.414835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-28f45a35-22d0-481b-87b5-1a2002d4de7f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:38.420842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-28f45a35-22d0-481b-87b5-1a2002d4de7f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.421289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-28f45a35-22d0-481b-87b5-1a2002d4de7f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.422623 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-28f45a35-22d0-481b-87b5-1a2002d4de7f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.423060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-28f45a35-22d0-481b-87b5-1a2002d4de7f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.457727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:38.465537 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-122aa1fe-8f5e-4543-9bea-a147079e3629 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.179601 Jul 27 15:23:38.467892 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 195/379] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:38 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:38.472535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:38.473174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:38.481643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.482092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.482911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.483342 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.560074 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-28f45a35-22d0-481b-87b5-1a2002d4de7f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 33710 microversion: 2.20 time: 0.149725 Jul 27 15:23:38.561551 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 185/380] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:38 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 33710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:38.566743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-6298c3dc-dd40-48d8-aded-990e001bbe64 req-800d49fa-bffc-4489-b6a9-a6fad0584fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4", "tag": "dbbeb600-b621-44bf-8344-cb6ff9e0aa2c"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:38.568200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:38.568200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:23:38.575414 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-6298c3dc-dd40-48d8-aded-990e001bbe64 req-800d49fa-bffc-4489-b6a9-a6fad0584fe7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.575854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-6298c3dc-dd40-48d8-aded-990e001bbe64 req-800d49fa-bffc-4489-b6a9-a6fad0584fe7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.587167 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-6298c3dc-dd40-48d8-aded-990e001bbe64 req-800d49fa-bffc-4489-b6a9-a6fad0584fe7 service nova] Creating event network-changed:dbbeb600-b621-44bf-8344-cb6ff9e0aa2c for instance f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 on hv-cinder-80043 Jul 27 15:23:38.591754 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-6298c3dc-dd40-48d8-aded-990e001bbe64 req-800d49fa-bffc-4489-b6a9-a6fad0584fe7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029821 Jul 27 15:23:38.592330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 186/381] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:38.633519 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:38.648969 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-031340b5-85b6-49f4-a24c-27a9a6bfd5eb tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.171816 Jul 27 15:23:38.648969 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 196/382] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:38 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:38.657046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-18ce239f-a5e3-4e77-9222-271c785897f9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18ece514-7ccf-4f9c-a010-233548602332"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:38.658160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-18ce239f-a5e3-4e77-9222-271c785897f9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:38.664522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18ce239f-a5e3-4e77-9222-271c785897f9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.664977 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18ce239f-a5e3-4e77-9222-271c785897f9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.665821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18ce239f-a5e3-4e77-9222-271c785897f9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:38.666260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18ce239f-a5e3-4e77-9222-271c785897f9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:38.960554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-18ce239f-a5e3-4e77-9222-271c785897f9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307984 Jul 27 15:23:38.961157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 187/383] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:23:38 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:39.301147 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:39.301749 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:39.308020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.308459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.309243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.309669 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.318377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:39.319752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:39.325986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.326772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.327770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.328375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.518910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:39.524935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:39.528218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c65a3f88-0128-4b79-aa52-1a6a58c40103 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.231126 Jul 27 15:23:39.528806 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 197/384] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:39 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:39.534859 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:39.536100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-91c604b4-3eec-4554-92f7-6cc7b7aaadf4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.222639 Jul 27 15:23:39.539327 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 188/385] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:39 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:39.539514 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:39.547039 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.547475 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.548854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.549288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.572739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-756befb0-1626-4bd4-becc-a08147f34f1e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:39.578718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-756befb0-1626-4bd4-becc-a08147f34f1e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:39.585052 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-756befb0-1626-4bd4-becc-a08147f34f1e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.585500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-756befb0-1626-4bd4-becc-a08147f34f1e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.586428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-756befb0-1626-4bd4-becc-a08147f34f1e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.587163 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-756befb0-1626-4bd4-becc-a08147f34f1e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.693872 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:39.703157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a5407cdb-0714-41b1-8bc6-1ac8c9a9fbb7 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.173083 Jul 27 15:23:39.703649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 198/386] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:39 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:39.708275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:39.709357 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:39.715930 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.716379 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.717155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:39.717611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:39.727269 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-756befb0-1626-4bd4-becc-a08147f34f1e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 34235 microversion: 2.20 time: 0.157864 Jul 27 15:23:39.728273 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 189/387] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:39 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 34235 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:39.872530 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:39.880913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a8a59121-5817-470e-85a4-141d66f37403 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.176265 Jul 27 15:23:39.881480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 199/388] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:39 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:40.546491 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:40.546491 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:40.553325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:40.553928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:40.554389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.554940 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.555720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.556159 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.559643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.560078 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.560834 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.561261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.761419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:40.770408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:40.777362 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fe69c1e6-e81b-461f-8bdd-073d13c1ef46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.235257 Jul 27 15:23:40.785397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 190/389] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:40 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:40.785641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-15dd074d-4d20-43bc-89fd-68f4009c31e8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.231079 Jul 27 15:23:40.785641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 200/390] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:40 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:40.785967 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:40.785967 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:40.791403 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.791973 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.792738 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bb0f73a1-84d2-4d27-83d0-be1a9a6a5bf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:40.792954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.793602 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.793709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bb0f73a1-84d2-4d27-83d0-be1a9a6a5bf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:40.801451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb0f73a1-84d2-4d27-83d0-be1a9a6a5bf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.801727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb0f73a1-84d2-4d27-83d0-be1a9a6a5bf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.802490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb0f73a1-84d2-4d27-83d0-be1a9a6a5bf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.803020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb0f73a1-84d2-4d27-83d0-be1a9a6a5bf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.937063 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bb0f73a1-84d2-4d27-83d0-be1a9a6a5bf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 34922 microversion: 2.20 time: 0.153316 Jul 27 15:23:40.938172 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 201/391] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:40 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 34922 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:40.941412 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:40.946558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:40.947498 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:40.948762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0cda8326-dcd3-43ef-85c1-b8765262bb81 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.169050 Jul 27 15:23:40.949320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 191/392] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:40 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:40.958216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.958216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:40.958216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:40.958216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:41.091465 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:41.099167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e76da897-7e37-419f-9a92-102a52f77b6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.159087 Jul 27 15:23:41.099735 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 202/393] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:40 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:41.794761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:41.795381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:41.801901 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:41.802359 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:41.803310 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:41.803772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:41.803868 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:41.804768 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:41.810831 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:41.811272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:41.812048 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:41.812502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:42.007991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:42.018710 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:42.020926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-98a91ae5-413e-40ee-8d07-91b1d92c2682 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.230063 Jul 27 15:23:42.021512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 192/394] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:41 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:42.026032 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c80764aa-39a5-4f6c-8f07-33d4b186cc0e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:42.026611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-59e0edd4-057c-4637-bb93-968c84559e29 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.229021 Jul 27 15:23:42.027041 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c80764aa-39a5-4f6c-8f07-33d4b186cc0e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:42.027497 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 203/395] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:41 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:42.031676 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:42.032279 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:42.032786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c80764aa-39a5-4f6c-8f07-33d4b186cc0e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:42.033227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c80764aa-39a5-4f6c-8f07-33d4b186cc0e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:42.033986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c80764aa-39a5-4f6c-8f07-33d4b186cc0e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:42.034411 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c80764aa-39a5-4f6c-8f07-33d4b186cc0e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:42.038502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:42.038502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:42.039070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:42.039503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:42.178897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c80764aa-39a5-4f6c-8f07-33d4b186cc0e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 35363 microversion: 2.20 time: 0.155994 Jul 27 15:23:42.187911 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 193/396] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:42 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 35363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:42.191104 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:42.191812 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:42.199528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:42.199528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:42.200203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:42.200634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:42.401745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:42.408903 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e6b68ad9-805e-43e1-9a9e-618d95ce97dd tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.380475 Jul 27 15:23:42.409458 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 204/397] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:42 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:42.469839 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:42.477544 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-70e2988e-d0ec-42a6-be16-8de14d6c077a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.290943 Jul 27 15:23:42.478098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 194/398] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:42 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:43.043551 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:43.044371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:43.046822 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:43.047442 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:43.053180 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.053982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.054102 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.054411 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.054652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.054882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.055598 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.056127 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.258182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:43.265150 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:43.265398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c96ee78d-0abf-499a-b387-656800ad761f tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.225653 Jul 27 15:23:43.265909 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 205/399] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:43 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:43.270910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-64933cd0-272c-4518-b3bf-5772a58dc954 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:43.271865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-64933cd0-272c-4518-b3bf-5772a58dc954 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:43.273676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-71b0e32f-8f46-444c-a2a8-ff2b7946a963 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.230890 Jul 27 15:23:43.274411 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 195/400] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:43 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:43.277641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64933cd0-272c-4518-b3bf-5772a58dc954 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.278175 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64933cd0-272c-4518-b3bf-5772a58dc954 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.278961 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64933cd0-272c-4518-b3bf-5772a58dc954 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.279389 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-64933cd0-272c-4518-b3bf-5772a58dc954 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.393188 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-64933cd0-272c-4518-b3bf-5772a58dc954 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 36098 microversion: 2.20 time: 0.125314 Jul 27 15:23:43.393750 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 206/401] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:43 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 36098 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:43.425436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:43.426042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:43.431776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.432221 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.432975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.433477 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.495288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:43.495967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:43.503069 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.503516 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.504299 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.504727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.605365 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:43.614510 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3ed88954-01fc-4f06-a424-f939a768f39f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.191411 Jul 27 15:23:43.616397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 196/402] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:43 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:43.668153 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:43.676783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1290348d-0c8f-4a07-bb70-0a972ddfaa84 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.185352 Jul 27 15:23:43.677555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 207/403] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:43 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:43.810136 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-714ef114-4810-4464-bd5b-9f598a7d3775 req-0207bc32-3ce5-4424-af1c-0d077c21bf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075979c8-2724-4c53-a8c0-e92a5c68afaa", "name": "network-vif-plugged", "status": "completed", "tag": "0e446813-c2b6-4efe-993c-8e2a76687d55"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:43.811989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:43.811989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:23:43.819886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-714ef114-4810-4464-bd5b-9f598a7d3775 req-0207bc32-3ce5-4424-af1c-0d077c21bf51 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:43.820352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-714ef114-4810-4464-bd5b-9f598a7d3775 req-0207bc32-3ce5-4424-af1c-0d077c21bf51 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:43.832153 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-714ef114-4810-4464-bd5b-9f598a7d3775 req-0207bc32-3ce5-4424-af1c-0d077c21bf51 service nova] Creating event network-vif-plugged:0e446813-c2b6-4efe-993c-8e2a76687d55 for instance 075979c8-2724-4c53-a8c0-e92a5c68afaa on hv-cinder-80043 Jul 27 15:23:43.836859 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-714ef114-4810-4464-bd5b-9f598a7d3775 req-0207bc32-3ce5-4424-af1c-0d077c21bf51 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030785 Jul 27 15:23:43.837441 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 197/404] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:23:44.283385 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:44.285333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:44.290783 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:44.291492 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:44.298779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.299224 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.299964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.300084 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.300404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.300676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.301511 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.302116 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.503108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:44.510288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:44.510659 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a54630e4-6349-4467-9fe4-d4129ad98688 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.231271 Jul 27 15:23:44.512332 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 208/405] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:44 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:44.517691 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-57e08e02-5728-4d13-b4fd-237e96f2f7d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:44.518886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-57e08e02-5728-4d13-b4fd-237e96f2f7d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:44.520080 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-63cbb268-5877-4522-8d86-3c8c83f10a04 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.233131 Jul 27 15:23:44.520647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 198/406] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:44 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:44.525094 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-57e08e02-5728-4d13-b4fd-237e96f2f7d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.525546 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-57e08e02-5728-4d13-b4fd-237e96f2f7d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.526322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-57e08e02-5728-4d13-b4fd-237e96f2f7d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.526789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-57e08e02-5728-4d13-b4fd-237e96f2f7d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.629683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:44.630286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:44.636130 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.636570 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.637319 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.637744 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.665535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-57e08e02-5728-4d13-b4fd-237e96f2f7d9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 37040 microversion: 2.20 time: 0.151788 Jul 27 15:23:44.666414 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 209/407] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:44 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 37040 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:44.694154 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:44.694875 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:44.701329 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.701773 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.702565 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:44.702993 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:44.803253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:44.810395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1b4144d7-f9a9-460d-a264-0d690e58565f tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.184394 Jul 27 15:23:44.811060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 199/408] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:44 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:44.864157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:44.871419 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-63859331-669d-4543-94d3-02e73d0db6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.181274 Jul 27 15:23:44.871948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 210/409] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:44 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:45.527836 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:45.528534 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:45.534964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.535415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.536197 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.536631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.537467 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:45.538140 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:45.544636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.545095 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.545879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.546318 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.749343 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:45.757654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fb117d1d-d4d9-4189-9711-a645614a9bcf tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.233510 Jul 27 15:23:45.758424 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 200/410] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:45 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:45.763032 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-42776020-7a10-401c-b777-5d757ec3441f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:45.764181 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-42776020-7a10-401c-b777-5d757ec3441f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:45.768949 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:45.776989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-42776020-7a10-401c-b777-5d757ec3441f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.777427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-42776020-7a10-401c-b777-5d757ec3441f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.778251 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-42776020-7a10-401c-b777-5d757ec3441f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.778666 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-42776020-7a10-401c-b777-5d757ec3441f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.784934 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-779ab0c8-9d6d-483b-b000-39b65b631703 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.251764 Jul 27 15:23:45.786205 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 211/411] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:45 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:45.828307 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:45.829212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:45.835402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.835993 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.836978 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.837409 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.931900 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-42776020-7a10-401c-b777-5d757ec3441f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 37739 microversion: 2.20 time: 0.171926 Jul 27 15:23:45.936057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 201/412] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:45 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 37739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:45.938562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:45.939405 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:45.947215 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.948052 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:45.949046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:45.950709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:46.007584 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:46.017427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-27c32307-0bc8-499a-899e-f0e0246b7474 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1314 microversion: 2.1 time: 0.192743 Jul 27 15:23:46.018257 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 212/413] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:45 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:46.024513 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-e77e066c-c623-441e-b4bf-46a8fd10abfd req-56986807-6512-4be3-96dd-16e8b47f671c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9426eb11-80ee-4899-96d9-879ff00e4ca8", "name": "network-vif-plugged", "status": "completed", "tag": "b9a1824d-7a50-4376-9725-44dcdb38f530"}, {"server_uuid": "f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4", "name": "network-vif-plugged", "status": "completed", "tag": "dbbeb600-b621-44bf-8344-cb6ff9e0aa2c"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:46.026428 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:46.026428 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:23:46.035416 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-e77e066c-c623-441e-b4bf-46a8fd10abfd req-56986807-6512-4be3-96dd-16e8b47f671c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:46.035780 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-e77e066c-c623-441e-b4bf-46a8fd10abfd req-56986807-6512-4be3-96dd-16e8b47f671c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:46.050596 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-e77e066c-c623-441e-b4bf-46a8fd10abfd req-56986807-6512-4be3-96dd-16e8b47f671c service nova] Creating event network-vif-plugged:b9a1824d-7a50-4376-9725-44dcdb38f530 for instance 9426eb11-80ee-4899-96d9-879ff00e4ca8 on hv-cinder-80043 Jul 27 15:23:46.051102 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-e77e066c-c623-441e-b4bf-46a8fd10abfd req-56986807-6512-4be3-96dd-16e8b47f671c service nova] Creating event network-vif-plugged:dbbeb600-b621-44bf-8344-cb6ff9e0aa2c for instance f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 on hv-cinder-80043 Jul 27 15:23:46.058351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-e77e066c-c623-441e-b4bf-46a8fd10abfd req-56986807-6512-4be3-96dd-16e8b47f671c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038055 Jul 27 15:23:46.059385 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 213/414] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:46 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:46.111176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:46.118587 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-aaa3adec-d200-4032-a52d-25fb6b6f069c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.184385 Jul 27 15:23:46.119153 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 202/415] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:45 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:46.775494 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:46.776190 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:46.782202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:46.782698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:46.783463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:46.783898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:46.802271 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:46.803009 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:46.808894 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:46.809347 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:46.810115 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:46.810576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:46.989204 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:46.994369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:46.996846 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f8065af5-a298-45e4-b284-550e3577776d tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.225538 Jul 27 15:23:46.997427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 214/416] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:46 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:47.005440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-33800e96-efe9-486e-8eec-c503b83495b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:47.005440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-33800e96-efe9-486e-8eec-c503b83495b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:47.008812 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33800e96-efe9-486e-8eec-c503b83495b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.009255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33800e96-efe9-486e-8eec-c503b83495b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.010013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33800e96-efe9-486e-8eec-c503b83495b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.010446 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33800e96-efe9-486e-8eec-c503b83495b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.010557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-91534e10-224a-4b0a-91f8-448b60cbff67 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.212340 Jul 27 15:23:47.011184 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 203/417] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:46 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:47.034765 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:47.035464 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:47.041320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.041764 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.042611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.043045 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.180258 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:47.187785 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-22add81f-edea-4773-876e-0b928db48f1a tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1497 microversion: 2.1 time: 0.157073 Jul 27 15:23:47.191436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 204/418] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:47 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:47.195903 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:47.196505 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:47.202769 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.203515 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.204442 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.204951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.342806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:47.350815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-93002417-1ce0-498a-9d1c-1078632912db tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.158334 Jul 27 15:23:47.351376 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 205/419] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:47 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:47.484680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-33800e96-efe9-486e-8eec-c503b83495b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 38168 microversion: 2.20 time: 0.485780 Jul 27 15:23:47.485328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 215/420] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:46 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 38168 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:47.497087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-04f577fa-d86b-4428-b524-ffdca659900b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:47.502957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-04f577fa-d86b-4428-b524-ffdca659900b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.503400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-04f577fa-d86b-4428-b524-ffdca659900b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.564914 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-04f577fa-d86b-4428-b524-ffdca659900b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Going to try to stop instance {{(pid=107333) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 27 15:23:47.613871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-04f577fa-d86b-4428-b524-ffdca659900b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 202 len: 0 microversion: 2.1 time: 0.120067 Jul 27 15:23:47.614519 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 206/421] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:47 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:23:47.623016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:47.623721 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:47.630693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.631134 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.631919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.632338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.767783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:47.775363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f6109fb4-4829-4862-80f7-762658a361f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.156462 Jul 27 15:23:47.775937 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 216/422] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:47 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:47.897607 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:47.898435 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:47.904548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.904999 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.905862 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:47.906323 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:47.932951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:23:48.003816 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ff124253-3cd4-4d05-957b-e5fd2135fec9 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "DELETE /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 204 len: 0 microversion: 2.1 time: 0.110121 Jul 27 15:23:48.004489 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 207/423] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:23:47 2021] DELETE /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:23:48.014062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:48.014785 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:48.018189 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:48.018825 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:48.020493 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.020930 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.023307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.023307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.027124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.027565 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.028332 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.028756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.229745 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:48.235108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:48.239835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6c998ed8-0b5b-4e9d-aea2-b9a9dba76952 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1503 microversion: 2.1 time: 0.229793 Jul 27 15:23:48.240496 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 208/424] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:48 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:48.242619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-215cf35e-578d-4d69-a7ef-146340facbf3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.232585 Jul 27 15:23:48.245283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 217/425] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:48 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:48.245432 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:48.245999 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:48.251758 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.252198 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.252952 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.253398 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.367189 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:48.367832 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:48.373593 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.374041 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.374848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.375281 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.388131 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:48.396367 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0630e7f0-6a39-4dcf-9792-85dd4271b0b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.154324 Jul 27 15:23:48.396952 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 209/426] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:48 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:48.496590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cc0c9708-814f-4a67-ad16-794ceac3934a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:48.497705 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cc0c9708-814f-4a67-ad16-794ceac3934a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:48.504341 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc0c9708-814f-4a67-ad16-794ceac3934a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.504791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc0c9708-814f-4a67-ad16-794ceac3934a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.505562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc0c9708-814f-4a67-ad16-794ceac3934a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.506004 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc0c9708-814f-4a67-ad16-794ceac3934a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.514577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:48.523506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-31260975-e19f-43c9-8b61-7c354ea42079 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1319 microversion: 2.1 time: 0.159102 Jul 27 15:23:48.530029 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 218/427] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:48 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:48.697003 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cc0c9708-814f-4a67-ad16-794ceac3934a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 200 len: 38303 microversion: 2.20 time: 0.204038 Jul 27 15:23:48.697802 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 210/428] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:48 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 38303 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:48.708555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-49e7ce8a-7029-4544-96fc-9d645bd0b5dd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:48.709045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-49e7ce8a-7029-4544-96fc-9d645bd0b5dd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:48.715440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49e7ce8a-7029-4544-96fc-9d645bd0b5dd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.715883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49e7ce8a-7029-4544-96fc-9d645bd0b5dd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.716644 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49e7ce8a-7029-4544-96fc-9d645bd0b5dd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.717076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49e7ce8a-7029-4544-96fc-9d645bd0b5dd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.740879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-49e7ce8a-7029-4544-96fc-9d645bd0b5dd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/ips" status: 200 len: 152 microversion: 2.20 time: 0.036886 Jul 27 15:23:48.741459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 219/429] 10.222.0.37 () {60 vars in 1289 bytes} [Tue Jul 27 15:23:48 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:23:48.793218 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:48.794166 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:48.800973 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.801415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.802180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:48.802640 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:48.955369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:48.963443 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-26089f8a-df5c-47fa-828d-7068ae164631 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.174017 Jul 27 15:23:48.964086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 211/430] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:48 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:49.257045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:49.257576 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:49.258767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:49.259365 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:49.263455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.263910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.264676 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.265112 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.265218 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.265619 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.266383 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.266852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.469495 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:49.474781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:49.480133 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c0c42d4e-da75-492b-9e34-45529d26a245 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1503 microversion: 2.1 time: 0.226808 Jul 27 15:23:49.480909 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 220/431] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:49 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:49.484494 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-dc2226ac-5f8a-47bb-bdcf-64482717ad97 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1317 microversion: 2.1 time: 0.229256 Jul 27 15:23:49.485952 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 212/432] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:49 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:49.494495 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:49.495277 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:49.503702 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.504151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.504923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.505359 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.540931 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:49.541466 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:49.547654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.548678 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.549553 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.549993 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.680627 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:49.687814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-711c8074-7c2f-47d8-8bfe-8fa60703c589 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.205476 Jul 27 15:23:49.688400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 221/433] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:49 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:49.728393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:49.735723 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fbabc9c2-1d8c-430e-85a7-47abf34d0eb9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1508 microversion: 2.1 time: 0.198399 Jul 27 15:23:49.736288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 213/434] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:49 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:49.980548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:49.981155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:49.987547 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.988008 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:49.988765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:49.989197 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:50.148108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:50.155999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6e66da77-815d-4fcd-b9d0-c8f9ab59eab2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.179055 Jul 27 15:23:50.157147 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 222/435] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:49 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:50.497583 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:50.498441 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:50.501550 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:50.502174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:50.506775 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:50.508021 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:50.508137 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:50.508468 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:50.508846 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:50.509232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:50.509335 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:50.509659 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:50.713018 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:50.715910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:50.721155 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-89c26794-e8d9-42a1-a755-f1a397346562 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1503 microversion: 2.1 time: 0.227281 Jul 27 15:23:50.721716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 214/436] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:50 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:50.724043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2ed072e4-04dc-4ac0-804a-45e1a8b5d382 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1507 microversion: 2.1 time: 0.226559 Jul 27 15:23:50.724813 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 223/437] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:50 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:50.726031 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:50.726791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:50.732438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:50.732887 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:50.733654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:50.734081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:50.877288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:50.884544 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4c9f937a-1331-4828-a3a9-7f333ee586b8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.161717 Jul 27 15:23:50.885129 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 215/438] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:50 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:51.173777 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:51.174373 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:51.180166 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.180614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:51.181367 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.181794 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:51.321979 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:51.330105 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-33dd0943-73dc-4d47-b7d2-1bdbd29d292f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.160129 Jul 27 15:23:51.330689 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 224/439] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:51 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:51.667584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:51.668126 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:51.674164 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.674653 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:51.675419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.675851 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:51.698800 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lazy-loading 'flavor' on Instance uuid 330a8a79-8995-4ac2-b93f-656f98368132 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:23:51.737005 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:51.737619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:51.743471 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.744000 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:51.744769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.745244 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:51.892060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:51.899355 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7d7c739d-032f-4d1b-84ae-db048d208933 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1503 microversion: 2.1 time: 0.166071 Jul 27 15:23:51.899923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 225/440] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:51 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:51.904104 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:51.904706 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:51.910351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.910835 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:51.913132 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:51.914252 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:52.051542 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:52.059143 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ba349e83-9fd5-4eef-924a-617a4e96af8b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.158288 Jul 27 15:23:52.059695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 226/441] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:51 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:52.064830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8dfdedb3-f8aa-4fb2-b31a-ee1bd767529c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92f29c13-6369-4516-87c9-441da0d95b90"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:52.065984 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8dfdedb3-f8aa-4fb2-b31a-ee1bd767529c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:52.071997 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dfdedb3-f8aa-4fb2-b31a-ee1bd767529c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:52.072435 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dfdedb3-f8aa-4fb2-b31a-ee1bd767529c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:52.073209 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dfdedb3-f8aa-4fb2-b31a-ee1bd767529c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:52.073640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dfdedb3-f8aa-4fb2-b31a-ee1bd767529c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:52.390063 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8dfdedb3-f8aa-4fb2-b31a-ee1bd767529c tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "POST /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329042 Jul 27 15:23:52.390698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 227/442] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:23:52 2021] POST /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:52.395542 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:52.396237 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:52.402264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:52.402752 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:52.403522 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:52.403958 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:52.551138 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:52.558948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-dcf9e599-74fd-4450-b590-61374323b25b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.167147 Jul 27 15:23:52.559507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 228/443] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:52 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:52.915906 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:52.916569 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:52.923169 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:52.923871 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:52.924644 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:52.925275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.067022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424381d2fde4c47a559a821f327ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eedbf75f734b36b60ba0bf2bea7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:53.077805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6ccbdcf4-acf1-4818-8b79-07d0e4b9d3b2 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 200 len: 1503 microversion: 2.1 time: 0.165392 Jul 27 15:23:53.078425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 229/444] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:52 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:53.084970 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-34f1a300-c17a-4823-89c9-d669b6976ffd req-d1f8c247-ba15-4c8a-9261-d2bc979b5df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075979c8-2724-4c53-a8c0-e92a5c68afaa", "name": "network-vif-deleted", "tag": "0e446813-c2b6-4efe-993c-8e2a76687d55"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:53.087890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:23:53.087890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:23:53.093667 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-34f1a300-c17a-4823-89c9-d669b6976ffd req-d1f8c247-ba15-4c8a-9261-d2bc979b5df4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.094038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-34f1a300-c17a-4823-89c9-d669b6976ffd req-d1f8c247-ba15-4c8a-9261-d2bc979b5df4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.105248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-34f1a300-c17a-4823-89c9-d669b6976ffd req-d1f8c247-ba15-4c8a-9261-d2bc979b5df4 service nova] Creating event network-vif-deleted:0e446813-c2b6-4efe-993c-8e2a76687d55 for instance 075979c8-2724-4c53-a8c0-e92a5c68afaa on hv-cinder-80043 Jul 27 15:23:53.109861 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-34f1a300-c17a-4823-89c9-d669b6976ffd req-d1f8c247-ba15-4c8a-9261-d2bc979b5df4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030257 Jul 27 15:23:53.110503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 230/445] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:23:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:23:53.115329 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:53.115996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:53.121695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.122177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.122968 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.123403 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.261857 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:53.269035 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2466c89f-c3ae-4269-a958-1e8e90a2450e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1501 microversion: 2.1 time: 0.157344 Jul 27 15:23:53.269574 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 231/446] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:53 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:53.285483 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46656edd-c674-45b3-91ba-2e41b09b042a"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:53.286576 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:53.292161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.292704 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.293371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.294075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.317399 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] HTTP exception thrown: Cannot 'attach_volume' instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 while it is in vm_state rescued Jul 27 15:23:53.318452 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Returning 409 to user: Cannot 'attach_volume' instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 while it is in vm_state rescued {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:23:53.318842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-19de892f-085e-4ca0-b7c7-10674a930991 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037693 Jul 27 15:23:53.319565 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 232/447] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:23:53 2021] POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 27 15:23:53.327521 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-28dc977b-bb94-4323-93de-b80f0025d8ef tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:23:53.328095 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-28dc977b-bb94-4323-93de-b80f0025d8ef tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:53.337533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28dc977b-bb94-4323-93de-b80f0025d8ef tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.337982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28dc977b-bb94-4323-93de-b80f0025d8ef tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.338784 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28dc977b-bb94-4323-93de-b80f0025d8ef tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.339223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-28dc977b-bb94-4323-93de-b80f0025d8ef tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.406079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-28dc977b-bb94-4323-93de-b80f0025d8ef tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.082057 Jul 27 15:23:53.406738 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 233/448] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:23:53 2021] POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:23:53.415080 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:53.415771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:53.421851 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.422376 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.423308 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.423746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.573248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:53.581170 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3dd5c4f5-fd11-492d-b574-435f576a61a4 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1509 microversion: 2.1 time: 0.169674 Jul 27 15:23:53.581655 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 234/449] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:53 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:53.585905 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:53.586518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:53.591845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.592293 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.593045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:53.593477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:53.731733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:53.739932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-414f067a-dbeb-4086-8b8e-a7c3b07a020a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.157255 Jul 27 15:23:53.740763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 235/450] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:53 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:54.096046 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:54.096713 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] [instance: 075979c8-2724-4c53-a8c0-e92a5c68afaa] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:54.102283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.102755 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.103521 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.103951 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.118217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] HTTP exception thrown: Instance 075979c8-2724-4c53-a8c0-e92a5c68afaa could not be found. Jul 27 15:23:54.118830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] Returning 404 to user: Instance 075979c8-2724-4c53-a8c0-e92a5c68afaa could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:23:54.119650 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9487af80-0641-41c0-adc7-c7546e4b7fc6 tempest-VolumesActionsTest-44374182 tempest-VolumesActionsTest-44374182-project] 10.222.0.37 "GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa" status: 404 len: 111 microversion: 2.1 time: 0.027975 Jul 27 15:23:54.120194 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 236/451] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:54 2021] GET /compute/v2.1/servers/075979c8-2724-4c53-a8c0-e92a5c68afaa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:23:54.596967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:54.597772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:54.603836 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.604224 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.604994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.605427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.702767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-88ba2f18-cf9b-4f53-93f1-5af6e666247c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 202 len: 0 microversion: 2.20 time: 3.038859 Jul 27 15:23:54.707159 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 216/452] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:23:51 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 0 bytes in 3044 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:23:54.712370 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:54.713071 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:54.719252 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.719755 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.720601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.720966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.783998 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:54.802741 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4a38024f-7d6f-43f1-8726-195721992960 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1509 microversion: 2.1 time: 0.209214 Jul 27 15:23:54.803404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 237/453] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:54 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:54.807595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:54.808191 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:54.814873 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.815326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.816250 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:54.816801 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:54.924872 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:54.934003 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:54.935520 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:54.936672 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-62c067b1-20f7-4bc1-b020-1ee38b135c26 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.228227 Jul 27 15:23:54.937415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 217/454] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:23:54 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:23:54.991120 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:54.998837 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-85e6674a-a510-4785-a28b-b40aded50d0f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.194486 Jul 27 15:23:54.999393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 238/455] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:54 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:55.821100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:55.821864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:55.828253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:55.828696 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:55.829455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:55.829889 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:55.954141 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:55.954765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:55.961352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:55.961789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:55.962567 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:55.962993 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:55.968599 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:55.975897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cfc65c2f-10f8-41e2-9df2-8cbc4d06d5ec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1509 microversion: 2.1 time: 0.159586 Jul 27 15:23:55.976490 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 218/456] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:55 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:56.016227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:56.017008 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:56.023692 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:56.024236 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:56.025081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:56.025525 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:56.125947 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:56.134121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:56.135643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:56.136783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cf1674e1-0ea8-46c0-99b6-4179aed47fe0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.186330 Jul 27 15:23:56.137341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 239/457] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:23:55 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:23:56.185604 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:56.194098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-521103d1-4b66-469f-bf7c-6bb5da2716aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.181671 Jul 27 15:23:56.194684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 219/458] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:56 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:56.992057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:56.992656 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:56.998408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:56.998878 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:56.999627 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:57.000051 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:57.133424 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:57.140727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b098897c-6ae9-486b-b671-ecb205470b88 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1509 microversion: 2.1 time: 0.152265 Jul 27 15:23:57.141284 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 240/459] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:56 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:57.155126 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:57.155739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:57.162258 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:57.162686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:57.163458 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:57.163895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:57.210180 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:57.210803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:57.216348 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:57.216787 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:57.217535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:57.217963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:57.330338 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:57.338087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:57.339632 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:57.340774 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f53c50a6-ae05-4960-aa23-2fab73c782ce tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.189347 Jul 27 15:23:57.341339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 220/460] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:23:57 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:23:57.390233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:57.398040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2cbba3de-edee-430f-9161-6c0345b7f2ad tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.191590 Jul 27 15:23:57.398619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 241/461] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:57 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:58.157023 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:58.157564 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:58.163718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:58.164152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:58.164911 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:58.165337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:58.295572 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:58.303644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7de69df8-8559-45c4-ab58-012e1c20dee8 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1509 microversion: 2.1 time: 0.150297 Jul 27 15:23:58.304197 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 221/462] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:58 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:58.364249 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:58.364852 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:58.370601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:58.371046 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:58.371803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:58.372237 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:58.415278 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:58.415816 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:58.421697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:58.422151 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:58.422935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:58.423364 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:58.557451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:58.565635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:58.567199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:58.568560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-519518ce-5929-490f-9265-132bd81dd915 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.208379 Jul 27 15:23:58.569206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 242/463] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:23:58 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:23:58.597835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:58.606326 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b9823909-dfe4-4420-8412-fae5ba2fd6e0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.194804 Jul 27 15:23:58.607125 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 222/464] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:58 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:23:59.320534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:59.321139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:59.327124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:59.327566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:59.328331 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:59.328760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:59.459294 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:59.466407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-95dfac8a-a755-4e32-82ea-d620a5f7a588 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1509 microversion: 2.1 time: 0.149756 Jul 27 15:23:59.467277 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 243/465] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:59 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:23:59.585364 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:59.585969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:59.591719 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:59.592163 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:59.592916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:59.593353 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:59.622965 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:23:59.623578 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:23:59.630335 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:59.630815 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:59.631583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:23:59.632014 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:23:59.779984 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:59.788180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:59.789704 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:59.790887 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ec09afda-e830-4df3-91ae-e1e2fae67a18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.209172 Jul 27 15:23:59.791407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 223/466] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:23:59 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:23:59.831015 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:23:59.838973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-548e558e-a098-4fac-959e-fc3554dc2ace tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.219530 Jul 27 15:23:59.839697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 244/467] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:23:59 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:00.483644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:00.484249 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:00.490567 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:00.491010 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:00.491767 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:00.492193 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:00.624593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:00.631762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0fb2765f-b579-4b4f-940f-479ab21ec2ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1509 microversion: 2.1 time: 0.151778 Jul 27 15:24:00.632317 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 224/468] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:00 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:00.809032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:00.809641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:00.815882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:00.816325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:00.817090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:00.817549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:00.859925 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:00.860540 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:00.872467 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:00.873168 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:00.873786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:00.874103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:01.055407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:01.067509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:01.070327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:01.072643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d379af4c-e1d9-4365-aeda-562b7f2c4765 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.267088 Jul 27 15:24:01.074814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 245/469] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:00 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:01.082258 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:01.087068 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:01.096278 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:01.098083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:01.098646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:01.099507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:01.100014 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:01.105673 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bfa0bd7b-1c23-4a0e-b6e1-ef4cef42d847 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.253305 Jul 27 15:24:01.106241 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 225/470] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:00 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:01.192758 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lazy-loading 'services' on Instance uuid f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:24:01.257723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7000fa56-e445-4e0c-9fd6-87445317da16 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4/os-volume_attachments/92f29c13-6369-4516-87c9-441da0d95b90" status: 202 len: 0 microversion: 2.1 time: 0.180843 Jul 27 15:24:01.261490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 246/471] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:24:01 2021] DELETE /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4/os-volume_attachments/92f29c13-6369-4516-87c9-441da0d95b90 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:24:01.647959 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:01.648557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:01.654828 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:01.655280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:01.656044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:01.656477 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:01.801150 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:01.809719 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6bf98bf5-de7b-4a2f-bd7a-2f8fa84bb6d9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1515 microversion: 2.1 time: 0.165481 Jul 27 15:24:01.810395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 226/472] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:01 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:02.091670 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:02.093122 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:02.105241 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:02.105765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:02.106640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:02.107184 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:02.123653 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:02.124422 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:02.132727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:02.136981 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:02.138168 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:02.138840 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:02.332282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:02.343194 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:02.346893 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:02.348694 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:02.350348 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-649646cf-00d8-4fd1-9e85-1cb7b7cb9f46 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.262988 Jul 27 15:24:02.351149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 247/473] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:02 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:02.366017 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fa654a68-f603-4b6f-bafc-35dfd220766d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.246043 Jul 27 15:24:02.366617 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 227/474] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:02 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:03.154686 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:03.155279 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:03.161102 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.161543 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.162292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.162759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.298757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:03.306443 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9a51cc83-81ea-42ba-a9de-ccd1feca5128 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1515 microversion: 2.1 time: 0.155633 Jul 27 15:24:03.307028 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 248/475] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:03 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:03.322865 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ce9da188-ef29-4254-a860-695983c83f23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2983c7a7-6fa5-46d2-8d48-ea7546590c3c"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:03.324000 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ce9da188-ef29-4254-a860-695983c83f23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:03.329794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce9da188-ef29-4254-a860-695983c83f23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.330794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce9da188-ef29-4254-a860-695983c83f23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.331086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce9da188-ef29-4254-a860-695983c83f23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.331521 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce9da188-ef29-4254-a860-695983c83f23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.369461 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:03.370337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:03.377076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.379256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.380700 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.381330 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.546376 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:03.555336 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:03.557084 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:03.558345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bd7754f5-b5a2-463c-8fc2-872cbb0867af tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.193248 Jul 27 15:24:03.559231 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 249/476] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:03 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:03.569023 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:03.569634 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:03.575669 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.576120 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.576948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:03.577383 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:03.624467 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ce9da188-ef29-4254-a860-695983c83f23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305272 Jul 27 15:24:03.625047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 228/477] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:24:03 2021] POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:24:03.732637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:03.740211 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5e64d497-f88c-42dd-bf91-67ee74586c72 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.179745 Jul 27 15:24:03.740776 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 250/478] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:03 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:04.576943 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:04.578741 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:04.589339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.590049 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:04.591071 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.591679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:04.602493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:04.603086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:04.609794 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.610318 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:04.611495 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.612239 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:04.641050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:24:04.747610 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-52a22dbf-5cbd-415b-a351-cc2d0c27edd6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 204 len: 0 microversion: 2.1 time: 0.148479 Jul 27 15:24:04.748336 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 251/479] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:24:04 2021] DELETE /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:24:04.759208 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:04.762874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:04.768973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:04.774871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:04.776841 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:04.778218 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-036d19e7-240d-4905-bf5a-cf26903dea98 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.205275 Jul 27 15:24:04.779165 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 229/480] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:04 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:04.785824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:04.786040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.786403 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:04.787261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.787526 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:04.787692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:04.796512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.797194 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:04.798360 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:04.798989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:05.007560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:05.020861 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-24788c35-5140-42df-9052-475c10548bab tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1513 microversion: 2.1 time: 0.268444 Jul 27 15:24:05.027200 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 252/481] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:04 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:05.027599 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:05.036051 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d3e11b12-aa2d-4561-a5f2-4851604a7350 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.255784 Jul 27 15:24:05.036606 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 230/482] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:04 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:05.802943 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:05.803554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:05.810157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:05.810647 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:05.811415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:05.811872 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:05.962119 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:05.970374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:05.971967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:05.973134 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a4455632-0afd-47fd-a5d8-d9b58d016763 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.173822 Jul 27 15:24:05.973637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 253/483] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:05 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:06.039401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:06.040028 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:06.052458 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:06.052929 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:06.053728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:06.054173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:06.057947 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:06.059196 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:06.068896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:06.069580 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:06.070567 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:06.071703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:06.280794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:06.290621 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4235bb37-2b58-4d96-9aaa-eaf8f32be2ef tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1513 microversion: 2.1 time: 0.254433 Jul 27 15:24:06.291731 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 231/484] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:06 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:06.300640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:06.315921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e6734232-5f99-489e-9690-f8e079257c57 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.265736 Jul 27 15:24:06.316496 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 254/485] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:06 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:06.992684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:06.993428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:07.000095 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:07.000537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:07.001299 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:07.001727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:07.158408 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:07.168358 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:07.170693 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:07.172979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1da71a7a-fd07-4ed7-b01b-0c52b530b192 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.184732 Jul 27 15:24:07.173883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 232/486] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:06 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:07.309087 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:07.309739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:07.326516 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:07.326998 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:07.327927 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:07.328398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:07.333044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:07.333668 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:07.350523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:07.351064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:07.351922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:07.352507 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:07.824418 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:07.832206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cca72e59-8f75-4294-b208-0982e3fd5e7e tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1513 microversion: 2.1 time: 0.526773 Jul 27 15:24:07.832858 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 255/487] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:07 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:07.845079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:07.855117 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8d67f7e5-54a5-41e6-a313-01afc918356b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.525760 Jul 27 15:24:07.855750 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 233/488] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:07 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:08.193963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:08.195308 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:08.208908 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.209451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.210316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.210868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.212051 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-f2d027b4-346d-4bae-8a6c-071d3f9979af req-350c75fb-6c6d-47d4-bbd8-2689731fa505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4", "name": "network-vif-deleted", "tag": "dbbeb600-b621-44bf-8344-cb6ff9e0aa2c"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:08.213652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:08.213652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:24:08.232917 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f2d027b4-346d-4bae-8a6c-071d3f9979af req-350c75fb-6c6d-47d4-bbd8-2689731fa505 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.233361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f2d027b4-346d-4bae-8a6c-071d3f9979af req-350c75fb-6c6d-47d4-bbd8-2689731fa505 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.263835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-f2d027b4-346d-4bae-8a6c-071d3f9979af req-350c75fb-6c6d-47d4-bbd8-2689731fa505 service nova] Creating event network-vif-deleted:dbbeb600-b621-44bf-8344-cb6ff9e0aa2c for instance f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 on hv-cinder-80043 Jul 27 15:24:08.270649 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-f2d027b4-346d-4bae-8a6c-071d3f9979af req-350c75fb-6c6d-47d4-bbd8-2689731fa505 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061699 Jul 27 15:24:08.271636 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 234/489] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:24:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:24:08.409808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:08.418922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:08.421560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:08.423010 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d8cea453-3e92-4312-b290-ecc508ebf37e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.233640 Jul 27 15:24:08.424146 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 256/490] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:08 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:08.850703 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:08.851490 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:08.857916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.858642 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.859432 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.859857 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.882766 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:08.884550 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:08.895119 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.895982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.896954 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.897548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.963320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:08.978361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:08.981615 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lazy-loading 'fault' on Instance uuid f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:24:09.099001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:09.106328 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-de92e545-2935-4fb2-8f29-d7cb021212e3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 200 len: 1307 microversion: 2.1 time: 0.261088 Jul 27 15:24:09.106929 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 235/491] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:08 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:09.182409 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:09.195552 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1775d33f-2705-45f6-beb5-c9b60bb27559 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1725 microversion: 2.1 time: 0.325266 Jul 27 15:24:09.198559 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 257/492] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:08 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:09.442349 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:09.442984 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:09.449196 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:09.449877 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:09.450821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:09.451419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:09.612507 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:09.620610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:09.622543 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:09.623879 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d408ef2b-45dc-4fdc-b509-db6e5083ae9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.185912 Jul 27 15:24:09.624432 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 236/493] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:09 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:10.124374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:10.128682 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:10.135144 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.135699 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.136487 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.137088 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.151791 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] HTTP exception thrown: Instance f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 could not be found. Jul 27 15:24:10.152407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Returning 404 to user: Instance f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:24:10.153247 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e847d26a-5f00-4d14-895a-84ddd1171d28 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4" status: 404 len: 111 microversion: 2.1 time: 0.033287 Jul 27 15:24:10.153790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 258/494] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:10 2021] GET /compute/v2.1/servers/f3aa1b9c-db8c-4c72-b2eb-6bf301d6cbb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:24:10.216443 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:10.217057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:10.225433 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.226131 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.227162 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.227707 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.363376 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:10.370970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4320801a-8a99-4bec-96cd-4e59029d1dd2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1702 microversion: 2.1 time: 0.158467 Jul 27 15:24:10.371528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 237/495] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:10 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:10.386732 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a9251a0f-16dd-486c-a2df-12a3315f05e3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:10.392454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a9251a0f-16dd-486c-a2df-12a3315f05e3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.392947 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a9251a0f-16dd-486c-a2df-12a3315f05e3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.451760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a9251a0f-16dd-486c-a2df-12a3315f05e3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Going to try to start instance {{(pid=107332) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 27 15:24:10.491760 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a9251a0f-16dd-486c-a2df-12a3315f05e3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 202 len: 0 microversion: 2.1 time: 0.108566 Jul 27 15:24:10.492334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 259/496] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:24:10 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:24:10.500050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:10.500655 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:10.506887 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.507346 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.508083 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.508510 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.638443 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:10.642551 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:10.643243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:10.646173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7af40d72-20a3-4b3e-bd0c-9f7e185e2c61 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.149679 Jul 27 15:24:10.646764 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 238/497] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:10 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:10.649092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.649543 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.650302 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:10.650763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:10.780679 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:10.788916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:10.790402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:10.791597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d90e2e05-db7c-4558-b40f-239b79260ccf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.153115 Jul 27 15:24:10.792141 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 260/498] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:10 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:11.663045 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:11.663654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:11.670119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:11.670601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:11.671364 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:11.671795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:11.808957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:11.809709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:11.814498 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:11.816116 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:11.816560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:11.817328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:11.817757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:11.822737 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-582cb3af-2163-4790-aa1f-156bb64998a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.163335 Jul 27 15:24:11.823309 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 239/499] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:11 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:11.948977 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:11.957232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:11.958746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:11.959870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-42c7b3fb-5f51-4223-a469-6f1055033f3f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.154655 Jul 27 15:24:11.960426 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 261/500] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:11 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:12.839786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:12.840508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:12.847168 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:12.847760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:12.848854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:12.849361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:12.977392 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:12.978057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:12.984525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:12.984973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:12.985748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:12.986212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:13.028455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:13.042097 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5ef1c3b3-366f-441c-87da-cd5c53f9a414 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.205814 Jul 27 15:24:13.053148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 240/501] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:12 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:13.164328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:13.172573 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:13.173984 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:13.175248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-98253fa9-e023-4e28-aff1-c7bc30f70fa2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.201485 Jul 27 15:24:13.175802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 262/502] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:12 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:14.061053 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:14.061658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:14.068372 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.068829 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.069600 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.070103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.193879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:14.194608 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:14.207828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.208360 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.209715 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.210346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.231094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:14.240547 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-36332525-c480-424a-a276-30fd2bb875a8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.183162 Jul 27 15:24:14.241397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 241/503] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:14 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:14.398824 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:14.407393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:14.409674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:14.410930 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a3700431-9974-4fd0-b544-146b062dbc2c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.221392 Jul 27 15:24:14.411677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 263/504] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:14 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:14.461596 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:14.462273 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:14.468469 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.469240 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.470080 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.470727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.505914 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:24:14.591148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-61fca62f-275c-4e4d-af6e-0da4e52fafda tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "DELETE /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 204 len: 0 microversion: 2.1 time: 0.132719 Jul 27 15:24:14.592746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 242/505] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:24:14 2021] DELETE /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:24:14.601785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:14.602400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:14.608926 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.609392 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.610197 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:14.610662 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:14.770394 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:14.777898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-edd42fbc-bdb0-4a38-b77b-02149150a443 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1514 microversion: 2.1 time: 0.180302 Jul 27 15:24:14.778484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 264/506] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:14 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:15.258609 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:15.259459 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:15.267034 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:15.267776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:15.268737 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:15.269172 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:15.420870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:15.429744 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:15.430934 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:15.435523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-adc595c9-8e71-4951-bb9c-471bbbab6043 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.180838 Jul 27 15:24:15.437078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 243/507] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:15 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:15.441312 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:15.441870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:15.443567 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:15.444179 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:15.622660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:15.630992 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:15.632772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:15.634156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-03b58cd5-95c3-4c8e-b724-a7707ea5655c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.208788 Jul 27 15:24:15.635302 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 265/508] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:15 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:15.795044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:15.795579 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:15.802114 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:15.802760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:15.803541 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:15.803978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:15.950576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:15.959624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d5d3eb9d-34f9-4a6e-a11a-4d53e16c7827 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1514 microversion: 2.1 time: 0.168557 Jul 27 15:24:15.960568 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 244/509] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:15 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:16.454008 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:16.454720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:16.460651 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:16.461115 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:16.461903 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:16.462342 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:16.622512 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:16.631326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1641d6f7-6c03-4e1f-81c2-ff27888ef50f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.180912 Jul 27 15:24:16.631999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 266/510] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:16 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:16.652348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:16.652982 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:16.659560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:16.660169 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:16.660933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:16.661450 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:16.804313 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:16.812187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:16.813700 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:16.814915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a83b3c38-62b1-47b6-b25b-753065248751 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1744 microversion: 2.20 time: 0.166565 Jul 27 15:24:16.816022 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 245/511] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:16 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:16.977264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:16.977901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:16.983769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:16.984237 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:16.984997 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:16.985426 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:17.145247 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:17.153560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9ba9e562-c4e1-4bd4-9985-7660473c5706 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1514 microversion: 2.1 time: 0.179744 Jul 27 15:24:17.165932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 267/512] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:16 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:17.648704 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:17.649718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:17.659042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:17.661158 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:17.662280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:17.662752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:17.703589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-60580889-cd6c-44d7-ae63-96939aa54cd2 req-bc464e98-1419-4226-9eff-a21872f61c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f5caae-fb56-41ed-8695-8b18f89a83d9", "name": "network-vif-deleted", "tag": "d2fa1e3e-69e0-4fdd-aae2-d048e8f8be3c"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:17.706854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:17.706854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:24:17.718632 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-60580889-cd6c-44d7-ae63-96939aa54cd2 req-bc464e98-1419-4226-9eff-a21872f61c38 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:17.719665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-60580889-cd6c-44d7-ae63-96939aa54cd2 req-bc464e98-1419-4226-9eff-a21872f61c38 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:17.732805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-60580889-cd6c-44d7-ae63-96939aa54cd2 req-bc464e98-1419-4226-9eff-a21872f61c38 service nova] Creating event network-vif-deleted:d2fa1e3e-69e0-4fdd-aae2-d048e8f8be3c for instance 32f5caae-fb56-41ed-8695-8b18f89a83d9 on hv-cinder-80043 Jul 27 15:24:17.739781 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-60580889-cd6c-44d7-ae63-96939aa54cd2 req-bc464e98-1419-4226-9eff-a21872f61c38 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040490 Jul 27 15:24:17.741348 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 268/513] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:24:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:24:17.834459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:17.834459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:17.841912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:17.842726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:17.843822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:17.844401 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:17.935544 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:17.950677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9ca22203-26e3-4672-a8d9-3a21412b0f85 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.306282 Jul 27 15:24:17.951644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 246/514] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:17 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:18.076444 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:18.085233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:18.086980 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:18.088101 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-79cae9c5-1c16-4dec-9915-4dd1aa6794ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1744 microversion: 2.20 time: 0.258442 Jul 27 15:24:18.088737 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 269/515] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:17 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:18.173165 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:18.173766 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:18.180413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:18.180861 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:18.181657 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:18.182091 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:18.212024 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:18.212401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:18.212854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lazy-loading 'fault' on Instance uuid 32f5caae-fb56-41ed-8695-8b18f89a83d9 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:24:18.257003 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:18.264384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-18f0ff45-fb03-4c6f-857d-45cc39a7ddc4 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 200 len: 1308 microversion: 2.1 time: 0.096524 Jul 27 15:24:18.264999 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 247/516] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:18 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:18.969234 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:18.970450 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:18.977030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:18.977482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:18.983744 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:18.984708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.109770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:19.110915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:19.129397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.130257 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.132046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.143738 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.394404 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:19.403808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c1e2aec4-545f-4244-9716-403f33d31fe4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.438390 Jul 27 15:24:19.404386 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 270/517] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:18 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:19.408736 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:19.409344 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 32f5caae-fb56-41ed-8695-8b18f89a83d9] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:19.420139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.422204 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.423510 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.424151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.446705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] HTTP exception thrown: Instance 32f5caae-fb56-41ed-8695-8b18f89a83d9 could not be found. Jul 27 15:24:19.447591 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Returning 404 to user: Instance 32f5caae-fb56-41ed-8695-8b18f89a83d9 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:24:19.448721 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-174b8074-dc99-4bcd-875f-9bd45779f0ac tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9" status: 404 len: 111 microversion: 2.1 time: 0.043374 Jul 27 15:24:19.449941 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 271/518] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:19 2021] GET /compute/v2.1/servers/32f5caae-fb56-41ed-8695-8b18f89a83d9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:24:19.459359 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:19.460367 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:19.468202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.468945 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.469889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.471249 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.506296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:24:19.529205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:19.545208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:19.552473 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:19.554013 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5a79c5f4-3252-4e1b-9ac5-b2bdc88baaf3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1744 microversion: 2.20 time: 0.449744 Jul 27 15:24:19.555685 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 248/519] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:19 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1744 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:19.612588 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-693c3631-6db4-41a0-9a91-cba26204eb1b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 204 len: 0 microversion: 2.1 time: 0.158142 Jul 27 15:24:19.613987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 272/520] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:24:19 2021] DELETE /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:24:19.622393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:19.623053 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:19.632305 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.632787 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.633726 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:19.634036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:19.840127 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:19.853176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6d80705d-87b5-43d7-8c0c-d770c16de349 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1513 microversion: 2.1 time: 0.234937 Jul 27 15:24:19.854286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 249/521] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:19 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:20.421918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:20.422890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:20.430383 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:20.431060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:20.431945 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:20.432377 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:20.573492 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:20.574992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:20.581859 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:20.582327 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:20.586601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:20.587040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:20.592784 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:20.601865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-50db9c7e-76ff-4b20-94d2-c6b690810b2b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.184386 Jul 27 15:24:20.602428 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 273/522] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:20 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:20.734013 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:20.744019 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:20.745538 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:20.746948 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8ae2ea6a-e252-49c8-87b3-eb60ea3e998e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.176950 Jul 27 15:24:20.747498 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 250/523] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:20 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:20.870305 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:20.870955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:20.877228 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:20.877684 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:20.879396 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:20.879511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:21.044019 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:21.047346 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-06c91440-2159-4145-879c-96ccd6f57070 req-cbd2ab33-c21c-440c-83e8-148f8b441c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330a8a79-8995-4ac2-b93f-656f98368132", "name": "network-vif-plugged", "status": "completed", "tag": "a03d9438-c7a4-446b-884f-370251dd9d3c"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:21.048966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:21.048966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:24:21.056022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-50d91309-b794-41b8-b7f7-0f979cb15257 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1513 microversion: 2.1 time: 0.189371 Jul 27 15:24:21.056889 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-06c91440-2159-4145-879c-96ccd6f57070 req-cbd2ab33-c21c-440c-83e8-148f8b441c28 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:21.057676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-06c91440-2159-4145-879c-96ccd6f57070 req-cbd2ab33-c21c-440c-83e8-148f8b441c28 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:21.066955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 274/524] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:20 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:21.070793 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-06c91440-2159-4145-879c-96ccd6f57070 req-cbd2ab33-c21c-440c-83e8-148f8b441c28 service nova] Creating event network-vif-plugged:a03d9438-c7a4-446b-884f-370251dd9d3c for instance 330a8a79-8995-4ac2-b93f-656f98368132 on hv-cinder-80043 Jul 27 15:24:21.076746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-06c91440-2159-4145-879c-96ccd6f57070 req-cbd2ab33-c21c-440c-83e8-148f8b441c28 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Jul 27 15:24:21.077507 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 251/525] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:24:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:24:21.619088 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:21.619852 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:21.625562 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:21.626236 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:21.627030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:21.627630 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:21.762999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:21.766806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:21.767505 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:21.771009 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1a62984d-c7cc-462a-b08d-736f7e34afb6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.155469 Jul 27 15:24:21.773528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:21.774176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:21.774980 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:21.775557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:21.780521 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 275/526] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:21 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:21.959709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:21.968103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:21.969850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:21.971211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ab140e4d-542d-4287-9748-0318e6c822f7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.208358 Jul 27 15:24:21.972266 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 252/527] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:21 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:22.074823 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:22.075721 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:22.083266 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:22.083849 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:22.084974 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:22.085603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:22.264284 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:22.276955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-04bc8031-8b43-487e-ae12-72bfc4bde58b tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 200 len: 1513 microversion: 2.1 time: 0.205848 Jul 27 15:24:22.277836 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 276/528] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:22 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:22.414698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-aa8d091c-3684-4a16-aeb6-dc2c6593b01d req-91070777-7ee6-4106-82ba-b23ea0237b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc4a45d-82a0-42f3-be6e-e50887766ef3", "name": "network-vif-deleted", "tag": "d505fe5d-eac3-4a9d-8e5d-b4beeb464099"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:22.416289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:22.416289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:24:22.424696 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-aa8d091c-3684-4a16-aeb6-dc2c6593b01d req-91070777-7ee6-4106-82ba-b23ea0237b44 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:22.425596 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-aa8d091c-3684-4a16-aeb6-dc2c6593b01d req-91070777-7ee6-4106-82ba-b23ea0237b44 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:22.437602 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-aa8d091c-3684-4a16-aeb6-dc2c6593b01d req-91070777-7ee6-4106-82ba-b23ea0237b44 service nova] Creating event network-vif-deleted:d505fe5d-eac3-4a9d-8e5d-b4beeb464099 for instance 9fc4a45d-82a0-42f3-be6e-e50887766ef3 on hv-cinder-80043 Jul 27 15:24:22.443503 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-aa8d091c-3684-4a16-aeb6-dc2c6593b01d req-91070777-7ee6-4106-82ba-b23ea0237b44 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032999 Jul 27 15:24:22.444102 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 253/529] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:24:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:24:22.787451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:22.788233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:22.794553 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:22.794947 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:22.795722 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:22.796158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:22.986499 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:22.992474 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:22.994132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:22.996866 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e071142a-79ee-4b91-a7c8-72f608dcc362 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1711 microversion: 2.1 time: 0.212915 Jul 27 15:24:22.998595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 277/530] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:22 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1711 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:23.015861 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:23.030146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:23.031088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:23.031528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:23.250788 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:23.270107 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:23.274022 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:23.275217 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-faf41500-2a2a-4377-a671-fe908b96acf7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.289767 Jul 27 15:24:23.275772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 254/531] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:22 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:23.295207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:23.296049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 9fc4a45d-82a0-42f3-be6e-e50887766ef3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:23.304421 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:23.304867 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:23.305629 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:23.306219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:23.320716 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] HTTP exception thrown: Instance 9fc4a45d-82a0-42f3-be6e-e50887766ef3 could not be found. Jul 27 15:24:23.321561 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Returning 404 to user: Instance 9fc4a45d-82a0-42f3-be6e-e50887766ef3 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:24:23.322583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-db70f1de-e906-44a8-9fcd-81462fa3d352 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3" status: 404 len: 111 microversion: 2.1 time: 0.031897 Jul 27 15:24:23.323327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 278/532] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:23 2021] GET /compute/v2.1/servers/9fc4a45d-82a0-42f3-be6e-e50887766ef3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:24:24.014805 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:24.016203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:24.069527 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.077112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:24.078796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.080808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:24.293556 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:24.294914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:24.305933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.307427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:24.310393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.311167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:24.352384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:24.361698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b56a27b5-b3e5-420d-9a5e-389b0ce983e8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1715 microversion: 2.1 time: 0.351539 Jul 27 15:24:24.368379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 255/533] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:24 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1715 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:24.579545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:24.580053 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:24.588598 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.589329 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:24.590290 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.590906 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:24.651033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:24:24.711633 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:24.726675 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:24.728411 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:24.736261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-05ad034b-2c34-4621-9ac2-5f40dcb50a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.446825 Jul 27 15:24:24.737256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 279/534] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:24 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:24.823908 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-56fb5db3-fa7a-4388-a032-115ebf634fe6 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "DELETE /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 204 len: 0 microversion: 2.1 time: 0.309775 Jul 27 15:24:24.824793 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 256/535] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:24:24 2021] DELETE /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:24:24.832966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:24.833705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:24.845703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.846374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:24.848718 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:24.849156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:25.037535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:25.060589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5df1b8b5-6423-4b52-b14f-65eb3a45d5a3 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1514 microversion: 2.1 time: 0.219967 Jul 27 15:24:25.060589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 280/536] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:24 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:25.335087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:25.337371 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:25.354090 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:25.355504 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:25.356735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:25.357776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:25.390700 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lazy-loading 'flavor' on Instance uuid 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:24:25.600725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3c2b1500-f78d-4d53-a1d4-18bad0f488dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action" status: 200 len: 32 microversion: 2.1 time: 0.270438 Jul 27 15:24:25.602085 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 257/537] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:24:25 2021] POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action => generated 32 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:24:25.611472 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:25.612520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:25.624204 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:25.637059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:25.638031 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:25.638541 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:25.758445 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:25.759116 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:25.772486 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:25.776885 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:25.777920 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:25.778381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:25.919668 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:25.939478 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6ec94618-03b9-4d2a-8487-fbeb1e612c05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.331819 Jul 27 15:24:25.940073 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 281/538] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:25 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:26.069191 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:26.075064 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:26.075682 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:26.090825 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:26.091740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:26.092977 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:26.097912 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:26.099126 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:26.102578 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:26.103928 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ba09165b-b5a1-4f3f-a7f5-60afc4b183b8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.350462 Jul 27 15:24:26.118347 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 258/539] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:25 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:26.439416 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:26.450935 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0323e24d-42b0-4227-9057-03d8a854fd72 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1514 microversion: 2.1 time: 0.385579 Jul 27 15:24:26.465572 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 282/540] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:26 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:26.971823 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:26.982648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:26.982648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:26.982648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:26.982648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:26.983094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:27.121751 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:27.122717 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:27.131594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:27.132078 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:27.133668 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:27.134156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:27.277292 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:27.288695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2492446a-3ffc-4b55-960b-6ee22189e7fe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.320474 Jul 27 15:24:27.301533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 259/541] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:26 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:27.399640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:27.415468 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:27.417051 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:27.418519 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cbd974a1-75b1-485b-be4b-876fb6bd78d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.300351 Jul 27 15:24:27.419130 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 283/542] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:27 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:27.469102 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:27.469727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:27.485702 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:27.494739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:27.495719 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:27.496181 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:27.715520 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:27.724843 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a77c251a-fe98-4bb4-8a2c-f8ae753ecea8 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1514 microversion: 2.1 time: 0.259583 Jul 27 15:24:27.735904 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 260/543] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:27 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:28.135434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-88cdbf06-72b0-44b4-b4bb-c04613334081 req-883b0f11-ea00-4708-8196-6d8ceaeb7b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c2bf55-7c6b-4a6d-9135-1458daaf0613", "name": "network-vif-deleted", "tag": "3b8cf6f8-2019-4de8-94cc-e634d7a1039f"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:28.137303 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:28.137303 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:24:28.152785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-88cdbf06-72b0-44b4-b4bb-c04613334081 req-883b0f11-ea00-4708-8196-6d8ceaeb7b57 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.153230 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-88cdbf06-72b0-44b4-b4bb-c04613334081 req-883b0f11-ea00-4708-8196-6d8ceaeb7b57 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.184138 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-88cdbf06-72b0-44b4-b4bb-c04613334081 req-883b0f11-ea00-4708-8196-6d8ceaeb7b57 service nova] Creating event network-vif-deleted:3b8cf6f8-2019-4de8-94cc-e634d7a1039f for instance 83c2bf55-7c6b-4a6d-9135-1458daaf0613 on hv-cinder-80043 Jul 27 15:24:28.189406 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-88cdbf06-72b0-44b4-b4bb-c04613334081 req-883b0f11-ea00-4708-8196-6d8ceaeb7b57 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058016 Jul 27 15:24:28.191839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 284/544] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:24:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:24:28.376629 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:28.377347 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:28.400043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.400487 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.401459 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.401810 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.441254 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:28.441254 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:28.452530 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.452978 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.453774 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.454549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.819527 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:28.827614 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-45687306-36ec-4b33-88bc-229dde846816 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.455726 Jul 27 15:24:28.843646 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 261/545] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:28 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:28.852026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:28.852641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:28.869415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.869874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.870704 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.871141 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.922785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:28.928998 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:28.929460 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:28.930624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lazy-loading 'fault' on Instance uuid 83c2bf55-7c6b-4a6d-9135-1458daaf0613 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:24:28.943502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:28.950639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:28.952555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-31b70183-2713-4fd1-9d65-2d2105ef7ebb tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.518214 Jul 27 15:24:28.963525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 285/546] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:28 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:29.011548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b825ab5c9074d2891ef14d3ee406e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe5cc0565843be92954f7f00c961c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:29.019753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ea9b8c4e-b54d-4c4d-bfb1-b9d4ff4f1108 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 200 len: 1307 microversion: 2.1 time: 0.174982 Jul 27 15:24:29.020539 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 262/547] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:28 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:29.844240 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:29.845478 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:29.865007 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:29.865767 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:29.866749 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:29.867339 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:29.971454 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:29.974176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:29.980456 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:29.981229 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:29.982243 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:29.982949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:30.090290 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:30.100019 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e0931799-f122-4299-b44f-9c6d1aeee643 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.259264 Jul 27 15:24:30.110832 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 286/548] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:29 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:30.116130 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:30.116751 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] [instance: 83c2bf55-7c6b-4a6d-9135-1458daaf0613] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:30.130985 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:30.131455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:30.132268 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:30.132706 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:30.162419 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] HTTP exception thrown: Instance 83c2bf55-7c6b-4a6d-9135-1458daaf0613 could not be found. Jul 27 15:24:30.167202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] Returning 404 to user: Instance 83c2bf55-7c6b-4a6d-9135-1458daaf0613 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:24:30.172385 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7601e410-ddd0-4b10-8a31-597c1b0c31f2 tempest-AttachVolumeNegativeTest-910279765 tempest-AttachVolumeNegativeTest-910279765-project] 10.222.0.37 "GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613" status: 404 len: 111 microversion: 2.1 time: 0.060302 Jul 27 15:24:30.174145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 287/549] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:30 2021] GET /compute/v2.1/servers/83c2bf55-7c6b-4a6d-9135-1458daaf0613 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:24:30.293336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:30.307275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:30.309563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:30.311081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-92e0926f-1f6e-46e0-b39b-8fe8a7b8f448 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.343518 Jul 27 15:24:30.312220 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 263/550] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:29 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:31.117394 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:31.118691 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:31.127865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:31.131789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:31.132904 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:31.133529 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:31.334656 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:31.336951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:31.356627 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:31.358300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:31.359480 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:31.360731 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:31.465863 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:31.474996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-771ad84f-27f2-4925-ba09-e20a8f5b2598 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.361496 Jul 27 15:24:31.476240 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 288/551] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:31 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:31.706077 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:31.719426 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:31.720860 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:31.722006 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c7c22434-1d6a-4224-842a-26e7973ede0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.395986 Jul 27 15:24:31.740707 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 264/552] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:31 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:32.492268 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:32.492880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:32.509578 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:32.511106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:32.511916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:32.512360 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:32.750690 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:32.751926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:32.759788 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:32.760779 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:32.761757 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:32.762351 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:32.907038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:32.924301 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-460dddc4-0f4c-4f6f-b30d-49ef1020272e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.432928 Jul 27 15:24:32.926711 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 289/553] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:32 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:33.074000 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:33.090300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:33.092049 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:33.093214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-80090bc4-590d-4027-aae1-ed0a1d887328 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.347665 Jul 27 15:24:33.104776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 265/554] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:32 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:33.943703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:33.944407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:33.951921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:33.953821 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:33.954989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:33.955652 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:34.114063 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:34.115186 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:34.121547 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:34.122584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:34.123637 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:34.124075 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:34.224006 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:34.271370 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fc01ce42-8456-4bbf-9501-01cf8600ceb7 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.331947 Jul 27 15:24:34.279526 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 290/555] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:33 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:34.346634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:34.357728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:34.359249 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:34.364266 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6a031b37-4544-478a-8e5b-1ec80a734850 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.256330 Jul 27 15:24:34.366647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 266/556] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:34 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:35.290190 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:35.290946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:35.297363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:35.297924 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:35.299049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:35.299590 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:35.384517 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:35.385084 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:35.391479 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:35.392166 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:35.392949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:35.393783 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:35.509219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:35.518782 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f723d62e-d102-4f6f-89b7-dc7a9fbf17ad tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.232697 Jul 27 15:24:35.519364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 291/557] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:35 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:35.577395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:35.585664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:35.587477 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:35.589668 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-44a48142-7cea-4381-b46a-45b78eb75131 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1739 microversion: 2.20 time: 0.208407 Jul 27 15:24:35.590362 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 267/558] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:35 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:36.535791 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:36.536397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:36.542137 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:36.542606 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:36.543620 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:36.544335 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:36.608988 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:36.609748 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:36.617082 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:36.617611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:36.618528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:36.619174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:37.157172 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:37.165882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6560e894-98f4-4aeb-a883-2429ba3a2e51 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.633856 Jul 27 15:24:37.166874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 292/559] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:36 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:37.221110 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:37.234036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:37.236059 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:37.237427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ae4aaa6c-9d5a-4e8f-8473-2c466efc2b47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1721 microversion: 2.20 time: 0.632178 Jul 27 15:24:37.239222 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 268/560] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:36 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1721 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:38.183272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:38.183982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:38.190921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:38.191082 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:38.191998 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:38.192551 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:38.257088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:38.258510 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:38.264536 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:38.264988 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:38.265768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:38.266247 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:38.429844 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:38.439378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4bdc815a-64c3-4f3c-a20f-8e5f16f25eec tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.259873 Jul 27 15:24:38.440362 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 293/561] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:38 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:38.446487 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fc99bb4b-44ac-4513-8bd6-ca41f307b128 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb4eb598-1a29-403f-ba06-32f66bafe7e4", "device": "/dev/sdb"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:38.448749 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fc99bb4b-44ac-4513-8bd6-ca41f307b128 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:38.458498 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc99bb4b-44ac-4513-8bd6-ca41f307b128 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:38.459480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc99bb4b-44ac-4513-8bd6-ca41f307b128 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:38.460590 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc99bb4b-44ac-4513-8bd6-ca41f307b128 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:38.461125 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fc99bb4b-44ac-4513-8bd6-ca41f307b128 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:38.535808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:38.544377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:38.545864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:38.547397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-14428650-8036-4719-8ee2-93dc3bc3a0bf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1721 microversion: 2.20 time: 0.295132 Jul 27 15:24:38.557938 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 269/562] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:38 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:38.803594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fc99bb4b-44ac-4513-8bd6-ca41f307b128 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "POST /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361742 Jul 27 15:24:38.804191 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 294/563] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:24:38 2021] POST /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:24:39.456856 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:39.458038 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:39.464990 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:39.465547 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:39.466404 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:39.466964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:39.569021 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:39.570567 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:39.603118 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:39.603885 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:39.605292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:39.605716 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:39.750274 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:39.767372 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9a775fb2-9070-4af8-a884-5e78b743c647 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.314215 Jul 27 15:24:39.769344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 270/564] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:39 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:39.840164 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:39.848962 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:39.850901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:39.852283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2e29c79d-7e27-4709-9189-7d620849ff9c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1724 microversion: 2.20 time: 0.288881 Jul 27 15:24:39.853333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 295/565] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:39 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:39.869948 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d7ac7759-0f0d-4e13-9620-e2825903c6b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46043a9b-1b8e-4785-940c-8bea640cb57e"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:39.871100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d7ac7759-0f0d-4e13-9620-e2825903c6b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:39.890738 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d7ac7759-0f0d-4e13-9620-e2825903c6b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:39.891324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d7ac7759-0f0d-4e13-9620-e2825903c6b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:39.892155 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d7ac7759-0f0d-4e13-9620-e2825903c6b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:39.892609 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d7ac7759-0f0d-4e13-9620-e2825903c6b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:40.343050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d7ac7759-0f0d-4e13-9620-e2825903c6b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.476705 Jul 27 15:24:40.349470 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 271/566] 10.222.0.37 () {62 vars in 1364 bytes} [Tue Jul 27 15:24:39 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-volume_attachments => generated 188 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:24:40.474557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b97902dd-5f28-43a9-8d8e-232b1cbf9e0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:40.475856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b97902dd-5f28-43a9-8d8e-232b1cbf9e0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:40.493195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b97902dd-5f28-43a9-8d8e-232b1cbf9e0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:40.493918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b97902dd-5f28-43a9-8d8e-232b1cbf9e0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:40.495083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b97902dd-5f28-43a9-8d8e-232b1cbf9e0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:40.495910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b97902dd-5f28-43a9-8d8e-232b1cbf9e0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:40.595463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b97902dd-5f28-43a9-8d8e-232b1cbf9e0b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action" status: 202 len: 0 microversion: 2.20 time: 0.125791 Jul 27 15:24:40.596090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 296/567] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:24:40 2021] POST /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:24:40.605289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:40.606051 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:40.622975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:40.623802 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:40.624837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:40.625518 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:40.785730 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:40.786347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:40.804493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:40.808206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:40.809945 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:40.810649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:40.837757 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:40.849706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:40.853417 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:40.855481 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b52162c6-6b1c-4998-bd0c-0b636f956812 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1750 microversion: 2.20 time: 0.253675 Jul 27 15:24:40.856385 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 272/568] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:40 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1750 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:41.021771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:41.033325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e1c18d49-02f7-4c1d-a3e8-f175ad905cd5 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.252013 Jul 27 15:24:41.046756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 297/569] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:40 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:41.185079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-0a374f1f-ea68-4d8e-bf1a-a252c4b861a7 req-6a47e1f3-93b2-42f4-a940-feee89e15714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330a8a79-8995-4ac2-b93f-656f98368132", "name": "network-vif-unplugged", "status": "completed", "tag": "a03d9438-c7a4-446b-884f-370251dd9d3c"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:41.186899 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:41.186899 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:24:41.195916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-0a374f1f-ea68-4d8e-bf1a-a252c4b861a7 req-6a47e1f3-93b2-42f4-a940-feee89e15714 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:41.196715 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-0a374f1f-ea68-4d8e-bf1a-a252c4b861a7 req-6a47e1f3-93b2-42f4-a940-feee89e15714 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:41.210410 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.compute.server_external_events [req-0a374f1f-ea68-4d8e-bf1a-a252c4b861a7 req-6a47e1f3-93b2-42f4-a940-feee89e15714 service nova] Unable to find a host for instance 330a8a79-8995-4ac2-b93f-656f98368132. Dropping event network-vif-unplugged {{(pid=107333) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 27 15:24:41.211396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-0a374f1f-ea68-4d8e-bf1a-a252c4b861a7 req-6a47e1f3-93b2-42f4-a940-feee89e15714 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030203 Jul 27 15:24:41.212051 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 273/570] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 15:24:41.879012 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:41.879729 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:41.900436 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:41.900805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:41.901602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:41.902039 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:42.051477 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:42.052152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:42.062287 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:42.064713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:42.066758 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:42.068416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:42.241456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:42.255188 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:42.259597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:42.263058 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b5ea444a-bdfe-4712-a45c-1f2ccd77f3d1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1750 microversion: 2.20 time: 0.389357 Jul 27 15:24:42.263653 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 298/571] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:41 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1750 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:42.377120 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:42.387042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d691ae91-11a0-4874-af66-a8719e0bb1f9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.340019 Jul 27 15:24:42.387863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 274/572] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:42 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:43.281009 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:43.281708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:43.292507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:43.294876 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:43.296363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:43.296922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:43.405546 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:43.406377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:43.416742 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:43.417197 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:43.418257 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:43.418683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:43.567748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:43.580912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:43.583099 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:43.587402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-08c3de0c-5600-46a4-8114-35a799fc9f09 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1752 microversion: 2.20 time: 0.310134 Jul 27 15:24:43.599007 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 299/573] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:43 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1752 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:43.679135 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:43.688494 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1d398936-a4ab-4b40-9493-49cdd4b4d000 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.286006 Jul 27 15:24:43.689329 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 275/574] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:43 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:44.604963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:44.605566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:44.611605 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:44.612660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:44.613469 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:44.614151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:44.705755 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:44.707043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:44.712872 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:44.713404 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:44.714175 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:44.714704 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:44.875798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:44.884955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:44.886930 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:44.888306 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-270aa248-6154-4fbe-a8aa-cffe4dcc92f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1752 microversion: 2.20 time: 0.287132 Jul 27 15:24:44.889206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 300/575] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:44 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:44.998834 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:45.007751 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bbb0c87c-8fc7-455a-8556-14ae8721522a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.305698 Jul 27 15:24:45.008577 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 276/576] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:44 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:45.907933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:45.908702 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:45.918539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:45.919133 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:45.920591 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:45.921030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:46.025348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:46.026790 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:46.036560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:46.038573 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:46.039610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:46.040978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:46.226415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:46.238968 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:46.243728 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:46.248839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-de4e79ac-baa5-4fb6-8988-7dd5ea9f7283 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1752 microversion: 2.20 time: 0.343606 Jul 27 15:24:46.249625 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 301/577] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:45 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1752 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:46.366695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:46.376283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b612fb47-2461-43c0-9be2-402a26601b73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.354801 Jul 27 15:24:46.378268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 277/578] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:46 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:47.271868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:47.273254 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:47.288611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:47.291800 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:47.294923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:47.295373 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:47.393922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:47.396846 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:47.410085 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:47.412575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:47.413589 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:47.414199 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:47.772019 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:47.786803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:47.788595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:47.789796 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8d7fd152-680b-4a40-ad29-2927e8ea46ff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1752 microversion: 2.20 time: 0.526653 Jul 27 15:24:47.790354 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 302/579] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:47 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1752 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:47.842989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:47.856251 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c570b83f-02a4-4133-875b-4b234fc10c8a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.466373 Jul 27 15:24:47.857711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 278/580] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:47 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:48.819624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:48.820269 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:48.830275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:48.830771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:48.832091 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:48.834334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:48.875621 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:48.876806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:48.891713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:48.892494 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:48.893345 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:48.894733 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:49.267586 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:49.292220 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-14b49af3-23f4-455f-9105-51ebaec9177a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.416705 Jul 27 15:24:49.293148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 279/581] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:48 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:49.302588 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:49.314573 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:49.316511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:49.318287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bd8c4e36-7a67-4332-9775-3446a7f47bd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1752 microversion: 2.20 time: 0.513896 Jul 27 15:24:49.328828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 303/582] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:48 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1752 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:50.308759 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:50.310123 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:50.317922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:50.318378 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:50.319187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:50.319622 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:50.337022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:50.337693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:50.344739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:50.345186 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:50.345963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:50.346393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:50.612938 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:50.641203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4f56305c-63e3-46a8-a127-03d9d4005c74 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.335974 Jul 27 15:24:50.646054 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 280/583] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:50 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:50.710945 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:50.720382 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:50.722745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:50.724678 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0db485f7-6ec2-41bb-a6a2-dd93699c4d70 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1752 microversion: 2.20 time: 0.391343 Jul 27 15:24:50.727078 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 304/584] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:50 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1752 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:51.658880 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:51.660720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:51.666956 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:51.667909 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:51.673815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:51.674351 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:51.745011 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:51.746287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:51.752408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:51.753652 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:51.757292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:51.757989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:51.889035 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:51.920824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5190f4eb-db9b-40f9-b4f1-8f99c1010f14 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.265790 Jul 27 15:24:51.921847 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 281/585] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:51 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:51.978665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:51.991442 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:51.993395 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:51.994759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fdcddd52-4eca-4e7b-a6bc-708f7574c1e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.253764 Jul 27 15:24:51.995570 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 305/586] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:51 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:52.938157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:52.939556 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:52.952838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:52.953451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:52.954378 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:52.955088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:53.015443 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:53.016783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:53.027548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:53.028337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:53.029340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:53.029974 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:53.193660 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:53.202918 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cab83fc6-2575-4040-8a61-3e1400fe8922 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.268432 Jul 27 15:24:53.203496 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 282/587] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:52 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:53.284079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:53.293055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:53.294761 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:53.295932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c9284db9-fbf4-4962-9a5f-0aad52c0185f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.286436 Jul 27 15:24:53.296485 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 306/588] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:53 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:54.221064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:54.222229 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:54.228992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:54.229442 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:54.230219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:54.238036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:54.314455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:54.315084 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:54.327597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:54.332475 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:54.334111 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:54.334897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:54.583217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:54.592492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:54.593989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:54.595186 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-60027848-ee01-44d1-93b6-d245f46494df tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.284331 Jul 27 15:24:54.610229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 307/589] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:54 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:24:54.658457 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:54.668134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6cd8334d-cdd5-4c44-afbc-58602e6fcb13 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.450413 Jul 27 15:24:54.676827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 283/590] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:54 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:55.628359 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:55.629579 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:55.636084 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:55.636532 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:55.637303 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:55.637734 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:55.693475 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:55.694739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:55.701431 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:55.701966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:55.702936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:55.703466 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:55.817880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:55.826334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:55.828015 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:55.829154 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-829cd33d-2ab2-4657-ba6d-bc8f1d89d8c2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.205161 Jul 27 15:24:55.841676 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 308/591] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:55 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:55.901962 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:55.910870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1467e09a-8c9a-408e-801d-723333ed507c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.221691 Jul 27 15:24:55.920914 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 284/592] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:55 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:56.848756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:56.850006 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:56.856117 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:56.856625 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:56.857604 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:56.858201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:56.927263 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:56.928527 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:56.936066 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:56.936534 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:56.937326 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:56.951087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:57.109512 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:57.118811 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:57.120697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:57.122098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c7129f66-806e-4f87-a816-4fc960ad0112 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.277194 Jul 27 15:24:57.130911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 309/593] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:56 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:57.181789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:57.190564 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cf039b1b-dd4d-4312-bdbb-7671723601dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.266828 Jul 27 15:24:57.200508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 285/594] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:56 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:58.141477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:58.142219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:58.148974 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:58.149692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:58.150751 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:58.151347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:58.208586 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:58.209890 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:58.218099 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:58.218933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:58.220114 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:58.220769 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:58.367591 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:58.379739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:58.384702 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:58.387040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b0d76ed8-1ad5-4c5e-873d-f3996777d598 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.249890 Jul 27 15:24:58.397049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 310/595] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:58 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:58.446322 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:58.454637 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-589553db-6b83-45ee-9713-254cc29c7919 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.250618 Jul 27 15:24:58.455217 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 286/596] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:58 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:59.421041 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:59.421678 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:59.428834 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:59.429295 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:59.430076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:59.430542 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:59.480776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:24:59.481559 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:24:59.488772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:59.499075 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:59.499916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:24:59.500367 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:24:59.634429 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:59.642644 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:59.644928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:59.646256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2867de6a-182c-4468-8fad-103d66c9e148 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.230986 Jul 27 15:24:59.647610 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 311/597] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:24:59 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:24:59.663656 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c58b838f-75b2-45f4-bee9-f9a0626b7482 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Action: 'create', calling method: .version_select at 0x7f33f7f97160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-863810951"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:59.691481 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:24:59.692898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-c58b838f-75b2-45f4-bee9-f9a0626b7482 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Getting quotas for project f9c187b19f4a4b289f866e96946b7e3c. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:24:59.696625 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-c58b838f-75b2-45f4-bee9-f9a0626b7482 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Getting quotas for user 4b1fedd1d1cd4e15b16026f89f792380 and project f9c187b19f4a4b289f866e96946b7e3c. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:24:59.699644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1d35390a-e476-4433-a6b9-42edc37fa08d tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.228420 Jul 27 15:24:59.699851 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 287/598] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:24:59 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:24:59.873121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-c58b838f-75b2-45f4-bee9-f9a0626b7482 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Getting quotas for project f9c187b19f4a4b289f866e96946b7e3c. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:24:59.876743 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-c58b838f-75b2-45f4-bee9-f9a0626b7482 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Getting quotas for user 4b1fedd1d1cd4e15b16026f89f792380 and project f9c187b19f4a4b289f866e96946b7e3c. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:24:59.892798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c58b838f-75b2-45f4-bee9-f9a0626b7482 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.232713 Jul 27 15:24:59.893992 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 312/599] 10.222.0.37 () {60 vars in 1158 bytes} [Tue Jul 27 15:24:59 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:24:59.939834 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1796704492", "imageRef": "07d6379e-c701-4091-997d-76b8a38bf827", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-863810951", "networks": [{"uuid": "d8e7fea8-d333-41cd-bdec-2aebe284f827"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:24:59.991964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] validate_networks() for [('d8e7fea8-d333-41cd-bdec-2aebe284f827', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:25:00.361797 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:25:00.362867 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:25:00.363331 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:25:00.363730 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:25:00.364132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:25:00.372641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:00.373060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:00.373847 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:00.374272 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:00.390603 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Getting quotas for project f9c187b19f4a4b289f866e96946b7e3c. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:25:00.394452 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Getting quotas for user 4b1fedd1d1cd4e15b16026f89f792380 and project f9c187b19f4a4b289f866e96946b7e3c. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:25:00.404793 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:25:00.406964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07d6379e-c701-4091-997d-76b8a38bf827',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:25:00.451112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7be29397-67be-45d5-9de4-02d04eea5c7e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514969 Jul 27 15:25:00.451744 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 288/600] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:24:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:25:00.461309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-544b1e6e-0bf8-4617-a292-7a4a379fed9d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:00.461922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-544b1e6e-0bf8-4617-a292-7a4a379fed9d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:00.516118 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-544b1e6e-0bf8-4617-a292-7a4a379fed9d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:00.523716 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-544b1e6e-0bf8-4617-a292-7a4a379fed9d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1258 microversion: 2.1 time: 0.065973 Jul 27 15:25:00.524214 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 313/601] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:00 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:00.665005 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:00.665614 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:00.671709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:00.672150 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:00.672906 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:00.673331 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:00.716137 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:00.716756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:00.724040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:00.724574 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:00.725485 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:00.726297 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:00.859226 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:00.867490 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:00.868973 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:00.870117 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c4d4303b-6756-42e5-b722-bf85deb0e2a9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.208874 Jul 27 15:25:00.870710 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 289/602] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:00 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:00.906665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:00.914787 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ef6feec2-d2af-4209-b432-522f6be127a3 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.202695 Jul 27 15:25:00.915342 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 314/603] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:00 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:01.540268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:01.541056 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:01.547354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:01.547799 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:01.548559 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:01.548990 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:01.609000 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:01.616567 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-850c769b-c4ed-4e2e-9061-d24fb4c58adc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1262 microversion: 2.1 time: 0.079922 Jul 27 15:25:01.617130 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 290/604] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:01 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:01.888766 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:01.889367 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:01.900641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:01.900641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:01.900641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:01.900641 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:01.931974 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:01.932724 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:01.939016 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:01.939764 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:01.941573 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:01.942280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:02.379162 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:02.394610 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:02.396590 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:02.398051 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3cf9c6a3-bd45-4ccb-97e3-0c7c245e768e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.512969 Jul 27 15:25:02.399937 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 315/605] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:01 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:25:02.427382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:02.437692 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b5c1aac8-f8a9-4eef-bafb-7342bf511d80 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1567 microversion: 2.1 time: 0.509770 Jul 27 15:25:02.438849 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 291/606] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:01 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1567 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:02.633975 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:02.634994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:02.653218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:02.654235 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:02.655862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:02.657117 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:02.752094 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:02.760295 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a8514db3-f690-485d-baf2-020c369a74df tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.130352 Jul 27 15:25:02.761595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 316/607] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:02 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:03.417752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:03.418507 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:03.425169 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.425932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.426687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.427118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.454871 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:03.456111 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:03.461894 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.462341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.463126 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.463803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.628773 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:03.637337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:03.639741 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:03.640918 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bcd91c4c-93da-4c54-b2c0-e0a89327b30f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.227156 Jul 27 15:25:03.651252 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 292/608] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:03 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:03.657868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:03.666212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c5639322-2387-461b-9239-6fe86c7200dd tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1547 microversion: 2.1 time: 0.214866 Jul 27 15:25:03.666827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 317/609] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:03 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1547 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:03.683296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:03.683844 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:03.690700 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.691144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.691915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.692346 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.776853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:03.777464 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:03.783146 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.783667 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.784412 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.784780 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.823519 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] HTTP exception thrown: Cannot 'detach_volume' instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 while it is in vm_state rescued Jul 27 15:25:03.824363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Returning 409 to user: Cannot 'detach_volume' instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 while it is in vm_state rescued {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:25:03.825349 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9078cae1-8e70-40c5-a08a-c850536eb567 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments/2983c7a7-6fa5-46d2-8d48-ea7546590c3c" status: 409 len: 152 microversion: 2.1 time: 0.146609 Jul 27 15:25:03.826116 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 293/610] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:25:03 2021] DELETE /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments/2983c7a7-6fa5-46d2-8d48-ea7546590c3c => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 15:25:03.834219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-96fed7fd-d4a8-4d8a-b981-c134616651bf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:03.835340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-96fed7fd-d4a8-4d8a-b981-c134616651bf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:03.842335 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-96fed7fd-d4a8-4d8a-b981-c134616651bf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.842884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-96fed7fd-d4a8-4d8a-b981-c134616651bf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.843724 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-96fed7fd-d4a8-4d8a-b981-c134616651bf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.844227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-96fed7fd-d4a8-4d8a-b981-c134616651bf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.847776 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:03.855097 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1c0699df-d440-478b-ad5e-2943dda91b84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.081774 Jul 27 15:25:03.855669 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 318/611] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:03 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:03.915418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-96fed7fd-d4a8-4d8a-b981-c134616651bf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.084947 Jul 27 15:25:03.919354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 294/612] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:25:03 2021] POST /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:25:03.925456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:03.926071 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:03.934177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.934765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:03.935534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:03.935967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:04.083851 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:04.093337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-668acfc6-e9dc-4c67-ac8c-64327a75d0e0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.172607 Jul 27 15:25:04.093919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 319/613] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:03 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:04.660275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:04.660986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:04.667540 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:04.667991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:04.668760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:04.669195 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:04.810295 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:04.819512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:04.821245 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:04.822491 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8d1e3a6a-da36-4a48-b04d-58ece9bf22fd tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.166419 Jul 27 15:25:04.823339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 295/614] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:04 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:04.872227 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:04.872929 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:04.878889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:04.879330 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:04.880092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:04.880518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:04.942965 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:04.950223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c965895c-4321-4b66-9a93-baace0decd12 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.081744 Jul 27 15:25:04.950854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 320/615] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:04 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:05.109967 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:05.110625 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:05.117386 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:05.117826 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:05.118627 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:05.119062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:05.267752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:05.276831 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2d330137-47c2-495a-9d4a-0c9b7eb80f5f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.170413 Jul 27 15:25:05.277656 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 296/616] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:05 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:05.842062 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:05.842640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:05.848502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:05.848954 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:05.849763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:05.850334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:05.966837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:05.967434 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:05.973268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:05.973715 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:05.974500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:05.974923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:05.993539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:06.003292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:06.005056 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:06.006338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-330a99a8-b80a-496e-bae1-bb07b07c7628 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.168066 Jul 27 15:25:06.007133 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 321/617] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:05 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:06.038058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:06.045807 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-26bc09e0-8fca-4d34-9193-945623730b00 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.082510 Jul 27 15:25:06.046371 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 297/618] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:05 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:06.294697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:06.295363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:06.301577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:06.302031 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:06.302847 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:06.303282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:06.443369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:06.451952 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-de300d2a-4de9-4360-ab8d-9d7815ffed23 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.161163 Jul 27 15:25:06.452568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 322/619] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:06 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:07.024366 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:07.024976 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:07.030847 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:07.031296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:07.032057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:07.032487 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:07.062997 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:07.063598 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:07.081016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:07.081470 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:07.082259 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:07.082725 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:07.158896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:07.164769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5c12b99c-9b03-4bbe-b041-ff34da7ff872 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.105001 Jul 27 15:25:07.165306 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 323/620] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:07 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:07.201647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:07.209685 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:07.211225 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:07.212341 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d664e7e5-29a6-43cf-949f-76054f42d71e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.191761 Jul 27 15:25:07.212887 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 298/621] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:07 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:07.235919 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:25:07.236115 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: Tue Jul 27 15:25:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:25:07.469875 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:07.470585 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:07.477245 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:07.477802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:07.478713 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:07.479184 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:07.621161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:07.629199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ece9e548-ec64-4293-90a0-f331da70cc60 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.162986 Jul 27 15:25:07.629808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 324/622] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:07 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:08.181039 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:08.181658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:08.187558 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:08.188012 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:08.188771 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:08.189203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:08.230511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:08.231282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:08.244155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:08.244609 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:08.245388 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:08.245820 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:08.262852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:08.269897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4276e0a3-89cb-4a18-a348-b202974c2533 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.092570 Jul 27 15:25:08.270460 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 299/623] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:08 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:08.384345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:08.392592 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:08.394137 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:08.395305 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3a963e05-e372-4eec-a5d1-74edb77095d2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.168505 Jul 27 15:25:08.395859 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 325/624] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:08 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:08.647837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:08.648542 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:08.654417 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:08.654894 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:08.655680 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:08.656104 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:08.803770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:08.812259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1faf27e4-ccb7-4f8b-861f-f714d41dd36f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.167844 Jul 27 15:25:08.813143 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 300/625] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:08 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:09.286411 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:09.287102 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:09.293251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:09.293693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:09.294455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:09.294909 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:09.357865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:09.366043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ceb2a05c-5c7c-4f91-a732-9d367b56a7a2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.083312 Jul 27 15:25:09.366737 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 326/626] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:09 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:09.413430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:09.414046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:09.420211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:09.420661 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:09.421428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:09.421862 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:09.556314 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:09.564758 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:09.566252 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:09.567420 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-53f5292d-29a9-4114-9998-bd0bd92c30e0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.157703 Jul 27 15:25:09.567971 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 301/627] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:09 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:09.828768 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:09.829363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:09.836103 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:09.837298 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:09.838332 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:09.839043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:09.994309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:10.003149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-25844dd3-5f7b-4b34-86f5-e60951818827 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.178050 Jul 27 15:25:10.003902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 327/628] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:09 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:10.382514 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:10.383134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:10.389426 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:10.389878 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:10.390685 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:10.391118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:10.454954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:10.462825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8536229f-c849-4123-a421-bbb4bca566b0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.083961 Jul 27 15:25:10.463382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 302/629] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:10 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:10.585393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:10.585975 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:10.592713 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:10.593155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:10.593928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:10.594388 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:10.745633 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:10.753785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:10.755299 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:10.756425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4cfb7656-9313-4569-a110-1c3236e52755 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.174856 Jul 27 15:25:10.756979 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 328/630] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:10 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:11.020993 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:11.021508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:11.028742 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:11.029762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:11.030679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:11.031279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:11.183934 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:11.193640 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0df0fdc3-4bce-418a-aefc-0ca60a7620d1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.177417 Jul 27 15:25:11.194211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 303/631] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:11 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:11.480703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:11.481372 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:11.488460 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:11.488994 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:11.489838 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:11.490339 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:11.554245 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:11.561568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-05e6f4e5-d627-4ead-b1be-1df3392a4324 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.084515 Jul 27 15:25:11.562142 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 329/632] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:11 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:11.774554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:11.775132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:11.781186 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:11.781631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:11.782447 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:11.782903 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:11.935864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:11.944402 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:11.946015 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:11.947278 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b2fdbdb6-06a2-42d6-adbe-8f5b38ecdd77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.176702 Jul 27 15:25:11.947915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 304/633] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:11 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:12.212203 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:12.212845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:12.219603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:12.220405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:12.222093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:12.222777 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:12.414942 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:12.423064 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-22076db3-d070-4117-86bc-2793403f7ff9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.215267 Jul 27 15:25:12.423632 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 330/634] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:12 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:12.579260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:12.579784 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:12.588224 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:12.588673 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:12.589452 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:12.589887 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:12.656651 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:12.664058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9dfa0ff4-a90b-4ddc-ba3e-58237249bc39 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.088621 Jul 27 15:25:12.664622 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 305/635] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:12 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:12.966520 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:12.967258 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:12.973214 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:12.973658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:12.974425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:12.974887 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:13.023925 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:13.025033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:13.030821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:13.031274 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:13.032047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:13.032483 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:13.119646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:13.120413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lazy-loading 'services' on Instance uuid 9426eb11-80ee-4899-96d9-879ff00e4ca8 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:25:13.127622 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:13.129100 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:13.130347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8cccde90-4d59-4f75-8412-71e6c1d65f49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.168477 Jul 27 15:25:13.130931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 331/636] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:12 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:13.225397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ed024ed3-629c-4894-8d3c-e0cccb5571ab tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8/os-volume_attachments/cb4eb598-1a29-403f-ba06-32f66bafe7e4" status: 202 len: 0 microversion: 2.1 time: 0.205073 Jul 27 15:25:13.226082 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 306/637] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:25:13 2021] DELETE /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8/os-volume_attachments/cb4eb598-1a29-403f-ba06-32f66bafe7e4 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:25:13.440601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:13.441207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:13.446979 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:13.447421 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:13.448165 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:13.448598 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:13.584238 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:13.591855 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5eca3f95-ff9a-40d6-adb3-18360e681721 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.154800 Jul 27 15:25:13.592419 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 332/638] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:13 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:13.682025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:13.682746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:13.688869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:13.689311 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:13.690777 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:13.691151 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:13.750926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:13.758512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6eea3e1f-f909-4635-9777-c891f1cc2e02 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.080425 Jul 27 15:25:13.759078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 307/639] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:13 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:14.148323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:14.148856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:14.155063 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:14.155512 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:14.156288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:14.156719 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:14.286288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:14.294759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:14.296263 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:14.297398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-78069e68-30d3-4fa0-a680-63d10385429c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.152883 Jul 27 15:25:14.297954 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 333/640] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:14 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:14.608855 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:14.609463 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:14.615891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:14.616339 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:14.617104 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:14.617533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:14.749481 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:14.757119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-52089733-b863-4be5-8379-3ee5fc538df0 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.151945 Jul 27 15:25:14.757678 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 308/641] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:14 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:14.774609 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:14.775215 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:14.780808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:14.781244 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:14.781996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:14.782419 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:14.841878 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:14.849267 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-26673ff2-ff01-4f22-b1fa-33770151cba4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.078204 Jul 27 15:25:14.849823 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 334/642] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:14 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:15.316294 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:15.316891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:15.322796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:15.323235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:15.323987 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:15.324413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:15.457500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:15.465424 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:15.466922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:15.468034 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-afddf2fd-48c9-49fd-83b6-44e9d167bc62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.156040 Jul 27 15:25:15.468593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 309/643] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:15 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:15.774108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:15.774769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:15.780440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:15.780894 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:15.781655 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:15.782090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:15.866304 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:15.867641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:15.873473 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:15.873916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:15.874918 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:15.875350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:15.956313 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:15.961630 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:15.964971 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6daf9a86-8aea-4a53-b266-9ebd578ad9cd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1310 microversion: 2.1 time: 0.102104 Jul 27 15:25:15.965457 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 310/644] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:15 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:15.969342 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-891ae916-7f74-4ab8-8937-bfac096393f1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.198943 Jul 27 15:25:15.970062 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 335/645] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:15 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:16.486420 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:16.487044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:16.493430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:16.493876 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:16.494859 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:16.495291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:16.653859 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:16.663061 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:16.664683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:16.665901 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0ed9cd74-aee4-40a1-a922-519867f7a879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.183246 Jul 27 15:25:16.666623 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 311/646] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:16 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:16.989456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:16.990060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:16.992992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:16.994152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:17.002368 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.004502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.005271 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.006730 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.007500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.008708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.009356 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.010015 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.328974 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:17.364662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8ce47e5b-7bb1-4147-a492-a86ce8e571bb tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.382217 Jul 27 15:25:17.370845 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 312/647] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:16 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:17.414577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:17.423136 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7efa5d31-07e5-4c41-81cb-bdf8f5db327f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.444098 Jul 27 15:25:17.424549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 336/648] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:16 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:17.561403 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:17.562148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:17.569199 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.569647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.570415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.570867 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.596549 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:25:17.701972 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:17.703150 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:17.708428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-99114bdd-7cda-4161-9065-77268e4ada6c tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 204 len: 0 microversion: 2.1 time: 0.145817 Jul 27 15:25:17.710014 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 313/649] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:25:17 2021] DELETE /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:25:17.727601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.728329 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.729323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.729908 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.730957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:17.731864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:17.747803 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.754342 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:17.755381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:17.755980 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:18.008353 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:18.018033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:18.019807 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:18.024222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:18.025720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2a1bdbc7-f9cc-4e18-be39-68e7b0731661 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.336155 Jul 27 15:25:18.028690 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b3c2c3e3-9a1c-4bcf-b860-657a33c214a7 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.301583 Jul 27 15:25:18.029141 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 337/650] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:17 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:25:18.029835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 314/651] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:17 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:18.387516 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:18.388556 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:18.396509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:18.397001 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:18.398302 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:18.398814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:18.441169 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:18.441778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:18.448067 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:18.448515 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:18.449368 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:18.450072 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:18.579280 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:18.587428 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4265a352-f44f-4e8f-97a3-c252ccd97cf1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.204379 Jul 27 15:25:18.588001 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 338/652] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:18 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:18.642686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:18.661049 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-607bada0-62ec-47ab-ab40-b72a3abca5ac tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.223904 Jul 27 15:25:18.661733 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 315/653] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:18 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:19.047910 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:19.048653 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:19.050194 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:19.050947 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:19.054779 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.055307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.055998 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.056618 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.057012 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.057468 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.058229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.058718 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.270589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:19.275858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:19.280968 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:19.283779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:19.285123 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8317341e-57b6-42a2-bfde-296d39807cc4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.243844 Jul 27 15:25:19.285711 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 339/654] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:19 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:19.286543 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a029c217-6fbe-4a7e-aa7e-d680cfdb36cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.242137 Jul 27 15:25:19.287147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 316/655] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:19 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:19.604723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:19.605245 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:19.611017 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.611964 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.612806 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.613284 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.677654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:19.678268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:19.694615 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.695064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.698676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:19.702790 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:19.814601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:19.823547 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-35f71222-717b-41bd-85af-05deb88480c9 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.222538 Jul 27 15:25:19.824684 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 340/656] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:19 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:19.884089 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:19.891388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0c2a7a11-636d-4aaa-89e9-ee61555f30dc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.218114 Jul 27 15:25:19.892132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 317/657] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:19 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:20.304213 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:20.304850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:20.305246 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:20.305352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:20.310664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.310805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.311109 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:20.311217 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:20.311866 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.311965 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.312295 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:20.312415 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:20.530176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:20.538162 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-66616e7b-cab1-4c4e-b7cb-9656a1935849 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.237542 Jul 27 15:25:20.545894 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 341/658] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:20 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:20.547377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:20.558529 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:20.560002 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:20.561157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-93bad251-71fd-4763-b72b-9607c8c431ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.260346 Jul 27 15:25:20.561701 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 318/659] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:20 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:25:20.841419 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:20.841950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:20.848878 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.849347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:20.850108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.850576 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:20.909162 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:20.910127 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:20.916523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.917349 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:20.929658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:20.930108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:21.109343 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:21.117639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-00a50111-9456-43f1-8c4f-9164b136a076 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.280130 Jul 27 15:25:21.120351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 342/660] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:20 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:21.175355 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:21.182324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f1600560-2f55-4b84-bddf-686428be10a7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.277522 Jul 27 15:25:21.183273 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 319/661] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:20 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:21.563479 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:21.564067 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:21.571101 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:21.571675 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:21.572561 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:21.573221 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:21.584784 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:21.586219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:21.596277 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:21.597087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:21.599473 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:21.603342 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:21.894344 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:21.899540 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:21.903398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-62478ef0-2628-4f79-827e-6ae7925af94d tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.343892 Jul 27 15:25:21.904317 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 343/662] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:21 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:21.908686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:21.912696 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:21.913902 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-38bdae9c-baa0-49f5-833e-69283ae1da38 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.332930 Jul 27 15:25:21.914536 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 320/663] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:21 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:22.137168 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:22.138161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:22.144310 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.145107 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:22.146093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.146745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:22.198709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:22.199321 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:22.205207 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.205881 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:22.206700 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.207371 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:22.393567 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:22.402187 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-742671bb-0612-4ede-bc0c-199d6d9d7abe tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.268778 Jul 27 15:25:22.407324 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 344/664] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:22 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:22.444067 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:22.452279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8fc88b79-fb21-4ca9-aeb6-3e73afed1b44 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.256971 Jul 27 15:25:22.462327 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 321/665] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:22 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:22.920052 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:22.921453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:22.927624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.929219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:22.930075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.930750 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:22.943949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:22.945308 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:22.954258 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.954786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:22.956065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:22.956521 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:23.374601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:23.382227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:23.384768 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-532bf185-3d09-402f-aba8-748a23adb8e3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.468574 Jul 27 15:25:23.385348 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 345/666] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:22 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:23.399726 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:23.401236 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:23.402590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b101fd0f-75c5-426b-a468-90b5be1be1dc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.467582 Jul 27 15:25:23.403300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 322/667] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:22 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:23.425294 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:23.425900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:23.432453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:23.432912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:23.433937 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:23.434692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:23.469074 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:23.469822 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:23.475745 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:23.476264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:23.477244 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:23.477737 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:23.634826 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:23.643649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9c9f03a3-3b7d-4d75-8e97-1b33bacea0cf tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.222652 Jul 27 15:25:23.644432 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 346/668] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:23 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:23.692674 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:23.701588 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e61f6886-492f-4474-9d8f-27290c7e7d30 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.236113 Jul 27 15:25:23.702240 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 323/669] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:23 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:24.401720 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:24.402347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:24.409031 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.409611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.410883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.411327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.420259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:24.420926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:24.426878 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.427696 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.428631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.429295 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.627549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:24.635227 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c6c23f5f-d5d3-4942-a88a-caa92867a074 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.237257 Jul 27 15:25:24.635795 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 347/670] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:24 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:24.652863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:24.661013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:24.661616 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:24.670735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:24.674075 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:24.676827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-20fb2682-d638-453b-9ea8-24a0266fd5e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.260541 Jul 27 15:25:24.690343 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.690822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.691616 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.692041 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.693867 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 324/671] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:24 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:25:24.718901 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:24.719542 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:24.725502 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.725958 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.726752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:24.727186 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:24.901046 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:24.909561 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5839bee8-19bf-4aef-b58b-be13057363a1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.252144 Jul 27 15:25:24.910374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 348/672] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:24 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:24.923327 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:24.931986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-579e556b-9ae3-407d-a5d9-45e374229091 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.216591 Jul 27 15:25:24.932565 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 325/673] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:24 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:25.652919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:25.653480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:25.659378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.659827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:25.660593 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.661035 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:25.695978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:25.696691 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:25.703770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.704525 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:25.705501 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.706094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:25.878569 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:25.886971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-725f0990-f9b2-4e1c-8529-b732c9233839 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.237831 Jul 27 15:25:25.887551 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 349/674] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:25 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:25.897303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:25.904484 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:25.905902 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:25.907080 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-91089cd6-59aa-42ce-a63f-eae93fe398cc tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.214747 Jul 27 15:25:25.907634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 326/675] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:25 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:25:25.926955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:25.927655 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:25.941990 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.942440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:25.943271 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.943705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:25.949559 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:25.949559 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:25.955256 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.955710 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:25.956488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:25.956924 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:26.164773 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:26.168378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:26.174396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-aae407fc-6187-46e1-a389-9900c9b1b167 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.229223 Jul 27 15:25:26.175166 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 327/676] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:25 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:26.176664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-11ba0efc-fb5d-4674-ac24-82469299e02c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.253445 Jul 27 15:25:26.177374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 350/677] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:25 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:26.756716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:26.758148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:26.766578 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:26.768394 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:26.769280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:26.769780 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:26.868533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lazy-loading 'services' on Instance uuid 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:25:26.904894 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:26.905553 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:26.912378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:26.913091 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:26.914151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:26.914943 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:26.973113 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6b94eeea-34d1-4b9d-9eec-f7e83fbe470c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/os-volume_attachments/18ece514-7ccf-4f9c-a010-233548602332" status: 202 len: 0 microversion: 2.1 time: 0.221164 Jul 27 15:25:26.973789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 328/678] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:25:26 2021] DELETE /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/os-volume_attachments/18ece514-7ccf-4f9c-a010-233548602332 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:25:26.979101 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:26.979872 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:26.986430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:26.987211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:26.988167 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:26.988953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:27.154833 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:27.172725 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-49da7d5b-eb90-407f-8481-cb855d0fdee1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.271250 Jul 27 15:25:27.174105 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 351/679] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:26 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:27.193921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:27.195137 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:27.203914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:27.204483 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:27.205885 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:27.206439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:27.322192 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:27.334112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:27.335656 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:27.336799 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8b4d92e6-448b-4b16-9a22-41df6a89c4aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.361725 Jul 27 15:25:27.337356 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 329/680] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:26 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:27.343289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:27.344118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:27.356500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:27.356951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:27.357720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:27.358330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:27.459084 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:27.466518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-83d49ad6-3a6f-4e46-9285-143274309006 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.276814 Jul 27 15:25:27.467169 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 352/681] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:27 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:27.553469 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:27.561479 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4141adac-31f7-46af-b043-e75bbe9bbf96 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.223144 Jul 27 15:25:27.562048 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 330/682] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:27 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:28.206902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:28.207516 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:28.213368 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.213818 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.214642 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.215079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.353329 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:28.356669 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:28.357396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:28.362076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4ff17c10-1555-492d-a975-416de40d3a64 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1560 microversion: 2.1 time: 0.159322 Jul 27 15:25:28.362617 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 353/683] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:28 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:28.364931 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.365440 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.366711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.367525 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.483206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:28.483913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:28.490212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.490790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.491644 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.492151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.512401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:28.528528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:28.531082 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:28.532775 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d06a37d1-2e7f-4ea6-a35c-4a67c8a2a3b9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.181232 Jul 27 15:25:28.533348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 331/684] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:28 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:25:28.579532 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:28.580532 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:28.589752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.590200 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.591772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:28.592363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:28.702387 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:28.711941 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-68051d6e-ff89-4059-856d-4fdd7f9c7da9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.232264 Jul 27 15:25:28.712796 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 354/685] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:28 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:28.785282 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:28.794244 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-53b0b179-3bd0-43b5-b824-a08f4588f18f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.219436 Jul 27 15:25:28.795332 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 332/686] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:28 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:29.147936 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-c700d07a-1b2d-4e72-9ec6-370eea0425d7 req-e6e3a2ee-f2ee-457b-adb6-51ef03f4b8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09456958-d9aa-49a0-b9ea-f982b7bee9d7", "tag": "0bb393d9-c24e-40b6-91a9-81412447d60f"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:29.149602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:29.149602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:25:29.168300 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-c700d07a-1b2d-4e72-9ec6-370eea0425d7 req-e6e3a2ee-f2ee-457b-adb6-51ef03f4b8aa service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.168745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-c700d07a-1b2d-4e72-9ec6-370eea0425d7 req-e6e3a2ee-f2ee-457b-adb6-51ef03f4b8aa service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.188691 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-c700d07a-1b2d-4e72-9ec6-370eea0425d7 req-e6e3a2ee-f2ee-457b-adb6-51ef03f4b8aa service nova] Creating event network-changed:0bb393d9-c24e-40b6-91a9-81412447d60f for instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 on hv-cinder-80043 Jul 27 15:25:29.195938 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-c700d07a-1b2d-4e72-9ec6-370eea0425d7 req-e6e3a2ee-f2ee-457b-adb6-51ef03f4b8aa service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051773 Jul 27 15:25:29.196757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 355/687] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:29.380243 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:29.381542 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:29.388235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.389025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.390044 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.391377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.552213 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:29.552805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:29.560251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.560705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.561482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.561918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.619334 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:29.633264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f1ed9c83-714c-4e34-8d5a-345828e6102b tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1514 microversion: 2.1 time: 0.257262 Jul 27 15:25:29.633964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 333/688] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:29 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:29.730029 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:29.731172 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:29.739344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.739928 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.740853 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.741298 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.745843 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:29.755185 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:29.757001 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:29.758232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a4ab456a-a6b0-4f4f-a081-aac004086dff tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.210428 Jul 27 15:25:29.758915 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 356/689] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:29 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:29.812631 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:29.813703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:29.820483 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.821287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.822442 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:29.823159 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:29.915485 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:29.930405 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fb74f533-36ce-408c-971f-7519e2d45e26 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.204844 Jul 27 15:25:29.931235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 334/690] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:29 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:29.991614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:30.000913 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c6e19924-9b81-4b08-8de3-17460faeebf2 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1555 microversion: 2.1 time: 0.191944 Jul 27 15:25:30.002131 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 357/691] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:29 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:30.301279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-24cd2dae-d226-493d-9a08-9b8088aaf6c7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:30.309052 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24cd2dae-d226-493d-9a08-9b8088aaf6c7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.309697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24cd2dae-d226-493d-9a08-9b8088aaf6c7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.334450 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-24cd2dae-d226-493d-9a08-9b8088aaf6c7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Going to try to stop instance {{(pid=107333) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 27 15:25:30.382962 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-24cd2dae-d226-493d-9a08-9b8088aaf6c7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 202 len: 0 microversion: 2.1 time: 0.085795 Jul 27 15:25:30.384768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 335/692] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:25:30 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:25:30.393074 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:30.393959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:30.400608 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.401322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.402341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.402996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.583242 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:30.593525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7ca9ebd8-899d-452e-bd78-4b08fd054105 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.204543 Jul 27 15:25:30.593950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 358/693] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:30 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:30.651334 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:30.653263 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:30.659676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.660334 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.661105 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.661695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.776067 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:30.776835 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:30.783219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.783219 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.784105 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.784739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.843291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:30.851929 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e93ee41f-139d-4c72-82de-17aaa43cea42 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1514 microversion: 2.1 time: 0.204787 Jul 27 15:25:30.852335 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 336/694] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:30 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:30.942244 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:30.947218 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:30.947908 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:30.949536 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:30.951265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:30.952639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2c82257f-6798-4afa-9cae-5ec3424db865 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.180359 Jul 27 15:25:30.953370 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 359/695] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:30 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:25:30.953807 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.954324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:30.955641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:30.956058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.018430 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:31.019351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:31.026017 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.026635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.027514 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.028213 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.128077 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:31.135424 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b849c2cc-00a3-43df-a0e2-306e83a7f43d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.191718 Jul 27 15:25:31.135988 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 337/696] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:30 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:31.197625 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:31.206531 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-14e23cf0-6e9a-40d8-a880-d24ddccd9d46 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1561 microversion: 2.1 time: 0.192256 Jul 27 15:25:31.207202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 360/697] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:31 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:31.289872 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:31.290394 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:31.296629 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.297315 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.298259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.298891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.391639 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lazy-loading 'services' on Instance uuid 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:25:31.463117 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8640c569-8edb-48e5-bb7c-c5a48b90f74e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments/2983c7a7-6fa5-46d2-8d48-ea7546590c3c" status: 202 len: 0 microversion: 2.1 time: 0.179417 Jul 27 15:25:31.463982 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 338/698] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:25:31 2021] DELETE /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2/os-volume_attachments/2983c7a7-6fa5-46d2-8d48-ea7546590c3c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:25:31.610116 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:31.610914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:31.616695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.617261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.618711 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.619246 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.769310 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:31.777394 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4dbe992d-59ad-46fe-b84f-98f4791ec974 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.170821 Jul 27 15:25:31.778048 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 361/699] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:31 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:31.847829 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-68ff5d7e-568c-412c-a2cd-8fc3c4b8dc13 req-94f47f85-375b-477a-b619-d91b2d0782b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9426eb11-80ee-4899-96d9-879ff00e4ca8", "name": "network-vif-deleted", "tag": "b9a1824d-7a50-4376-9725-44dcdb38f530"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:31.849658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:31.849658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:25:31.857140 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-68ff5d7e-568c-412c-a2cd-8fc3c4b8dc13 req-94f47f85-375b-477a-b619-d91b2d0782b7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.857663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-68ff5d7e-568c-412c-a2cd-8fc3c4b8dc13 req-94f47f85-375b-477a-b619-d91b2d0782b7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.868789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:31.869275 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:31.873545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-68ff5d7e-568c-412c-a2cd-8fc3c4b8dc13 req-94f47f85-375b-477a-b619-d91b2d0782b7 service nova] Creating event network-vif-deleted:b9a1824d-7a50-4376-9725-44dcdb38f530 for instance 9426eb11-80ee-4899-96d9-879ff00e4ca8 on hv-cinder-80043 Jul 27 15:25:31.875779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.876976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.877952 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.878601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.879159 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-68ff5d7e-568c-412c-a2cd-8fc3c4b8dc13 req-94f47f85-375b-477a-b619-d91b2d0782b7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036033 Jul 27 15:25:31.880061 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 339/700] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:31.947138 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:31.955865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1819b718-9d78-41e2-b976-b4af4a9dcce9 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 200 len: 1304 microversion: 2.1 time: 0.090859 Jul 27 15:25:31.956463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 362/701] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:31 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:31.973321 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:31.974031 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:31.981523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.981968 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:31.983265 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:31.983870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.153447 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:32.154285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:32.160515 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:32.162556 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.163524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:32.164127 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.174211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:32.192842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:32.194429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:32.195825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-739ee8ea-05e7-4c6a-8ad7-ba81ad88bdde tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.227963 Jul 27 15:25:32.196746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 340/702] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:31 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:32.316226 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:32.323294 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d05b9662-9b36-4687-99c3-ccef98315a2d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.174355 Jul 27 15:25:32.323858 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 363/703] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:32 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:32.794787 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:32.795425 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:32.803310 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:32.803781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.804630 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:32.806134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.807086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-f6c8c720-c848-443b-8ea6-7ea161267849 req-b57786a0-9ebd-43be-9dff-f60a8381f080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330a8a79-8995-4ac2-b93f-656f98368132", "name": "network-vif-plugged", "status": "completed", "tag": "a03d9438-c7a4-446b-884f-370251dd9d3c"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:32.808831 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:32.808831 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:25:32.817270 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-f6c8c720-c848-443b-8ea6-7ea161267849 req-b57786a0-9ebd-43be-9dff-f60a8381f080 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:32.817695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-f6c8c720-c848-443b-8ea6-7ea161267849 req-b57786a0-9ebd-43be-9dff-f60a8381f080 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.830799 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-f6c8c720-c848-443b-8ea6-7ea161267849 req-b57786a0-9ebd-43be-9dff-f60a8381f080 service nova] Creating event network-vif-plugged:a03d9438-c7a4-446b-884f-370251dd9d3c for instance 330a8a79-8995-4ac2-b93f-656f98368132 on hv-cinder-80043 Jul 27 15:25:32.838038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-f6c8c720-c848-443b-8ea6-7ea161267849 req-b57786a0-9ebd-43be-9dff-f60a8381f080 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035419 Jul 27 15:25:32.839423 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 364/704] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:32.952611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:32.960313 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6a562411-5078-4497-ad85-bb1a9d6af83f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.169630 Jul 27 15:25:32.960875 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 341/705] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:32 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:32.973518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:32.974216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 9426eb11-80ee-4899-96d9-879ff00e4ca8] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:32.980233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:32.980617 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.981373 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:32.981801 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:32.994305 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] HTTP exception thrown: Instance 9426eb11-80ee-4899-96d9-879ff00e4ca8 could not be found. Jul 27 15:25:32.994903 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Returning 404 to user: Instance 9426eb11-80ee-4899-96d9-879ff00e4ca8 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:25:32.995704 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9ea237d7-c4bf-4ca4-9152-2d372219e6e6 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8" status: 404 len: 111 microversion: 2.1 time: 0.026967 Jul 27 15:25:32.996206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 365/706] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:32 2021] GET /compute/v2.1/servers/9426eb11-80ee-4899-96d9-879ff00e4ca8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:25:33.215288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:33.219714 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:33.227079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:33.227526 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:33.228358 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:33.229042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:33.340800 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:33.346041 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:33.353099 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:33.353889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:33.355011 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:33.357199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:33.384879 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:33.393523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:33.395469 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:33.396808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3bd3c5b4-824f-4c73-8aa4-b93a0903a417 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.185256 Jul 27 15:25:33.408546 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 342/707] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:33 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:33.509345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:33.518651 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fad9ef49-b7e8-499e-a882-854660b258a3 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.182359 Jul 27 15:25:33.519220 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 366/708] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:33 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:33.977170 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:33.977775 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:33.983530 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:33.983970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:33.984721 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:33.985147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:34.124752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:34.132554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-02456182-72f2-4b7f-8881-52f316c5175a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.159014 Jul 27 15:25:34.133181 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 343/709] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:33 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:34.415202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:34.415999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:34.422060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:34.422539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:34.423320 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:34.423863 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:34.535326 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:34.535942 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:34.542049 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:34.542518 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:34.543288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:34.543724 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:34.556665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:34.565376 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:34.566880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:34.568020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6cabd082-98ce-4b70-8796-792e6cc30912 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.156502 Jul 27 15:25:34.568577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 367/710] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:34 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:34.673674 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:34.680888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-372982e3-21fc-4400-b2de-b68c8c41c962 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.149248 Jul 27 15:25:34.681450 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 344/711] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:34 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:35.149278 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:35.149916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:35.155708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:35.156154 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:35.156915 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:35.157828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:35.293563 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:35.300785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-367c1e56-cfc5-452c-875c-9b9ae61e1f38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.155269 Jul 27 15:25:35.301368 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 368/712] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:35 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:35.586019 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:35.586664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:35.592428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:35.592881 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:35.593645 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:35.594079 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:35.697797 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:35.698402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:35.704091 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:35.705093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:35.705914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:35.706587 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:35.727269 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:35.735416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:35.736899 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:35.738022 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9b7e3a2e-b18f-45e7-8ec4-3986ce2e7a43 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.155754 Jul 27 15:25:35.738608 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 345/713] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:35 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:35.840623 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:35.847732 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e44d17e2-a1e6-440b-b7f5-08593fbb16d9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.153474 Jul 27 15:25:35.848288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 369/714] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:35 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:36.317358 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:36.317970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:36.323809 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:36.324255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:36.325011 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:36.325442 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:36.455458 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:36.462623 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2a75ee0c-f38e-43b9-9869-ffc401c1cc6d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.149371 Jul 27 15:25:36.463178 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 346/715] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:36 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:36.755837 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:36.756379 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:36.762024 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:36.762481 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:36.763255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:36.763687 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:36.865364 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:36.866114 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:36.872011 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:36.872699 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:36.873356 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:36.873868 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:36.905424 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:36.914083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:36.915599 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:36.916995 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cabf59f0-cf55-41e9-86f4-4b72ad6234f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.165456 Jul 27 15:25:36.917544 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 370/716] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:36 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:37.036542 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:37.044035 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1334e065-ef9c-4a95-9d77-ba6bab42bbcd tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.182525 Jul 27 15:25:37.044594 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 347/717] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:36 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:37.479291 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:37.479922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:37.485820 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:37.486287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:37.487083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:37.487535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:37.626332 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:37.634392 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-71550249-fede-4aa5-a175-b6a554ef23b3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.158729 Jul 27 15:25:37.642950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 371/718] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:37 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:37.935835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:37.936514 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:37.943657 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:37.944107 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:37.944874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:37.945307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.031100 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:38.031591 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:38.037473 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.038011 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.039345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.039978 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.071969 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:25:38.149146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:38.159417 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:38.160015 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-133bb241-fb67-4d78-93a6-1036f992a2ed tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "DELETE /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 204 len: 0 microversion: 2.1 time: 0.131523 Jul 27 15:25:38.161784 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:38.163231 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2bf320c0-3f7d-409a-9d70-5e600d3e7c11 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1808 microversion: 2.20 time: 0.231215 Jul 27 15:25:38.163964 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 348/720] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:37 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:38.165406 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 372/720] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:25:38 2021] DELETE /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:25:38.171467 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:38.172330 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:38.177706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:38.178504 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:38.187303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.188078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.189523 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.190102 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.190839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.191545 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.192793 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.193305 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.435240 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:38.443999 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f2af35e9-e3e9-41c0-81b2-e93f14c1c462 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.278700 Jul 27 15:25:38.444575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 349/721] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:38 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:38.464848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:38.475352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-466ae221-cb37-452f-b8ce-b08be853079e tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1508 microversion: 2.1 time: 0.307641 Jul 27 15:25:38.476048 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 373/722] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:38 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:38.654352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:38.655097 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:38.661245 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.661678 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.662594 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.662924 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.808898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-bbf5b676-de69-46e4-bb75-a80909407f7b req-8653007d-7007-48f7-a132-a07c82e17196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09456958-d9aa-49a0-b9ea-f982b7bee9d7", "name": "network-vif-plugged", "status": "completed", "tag": "0bb393d9-c24e-40b6-91a9-81412447d60f"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:38.810770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:38.810770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:25:38.819183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-bbf5b676-de69-46e4-bb75-a80909407f7b req-8653007d-7007-48f7-a132-a07c82e17196 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:38.819999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-bbf5b676-de69-46e4-bb75-a80909407f7b req-8653007d-7007-48f7-a132-a07c82e17196 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:38.833757 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-bbf5b676-de69-46e4-bb75-a80909407f7b req-8653007d-7007-48f7-a132-a07c82e17196 service nova] Creating event network-vif-plugged:0bb393d9-c24e-40b6-91a9-81412447d60f for instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 on hv-cinder-80043 Jul 27 15:25:38.838794 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-bbf5b676-de69-46e4-bb75-a80909407f7b req-8653007d-7007-48f7-a132-a07c82e17196 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034871 Jul 27 15:25:38.839901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 374/723] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:25:38.867914 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:38.875768 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-681b9a70-b2e8-4863-a10c-afe047136826 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.227266 Jul 27 15:25:38.877153 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 350/724] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:38 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:39.181948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:39.182666 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:39.188562 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.189495 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:39.190252 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.190707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:39.328709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:39.337088 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:39.338602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:39.339734 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c8fd8c80-e454-4c60-982c-25a3cdaca480 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1795 microversion: 2.20 time: 0.161906 Jul 27 15:25:39.340405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 375/725] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:25:39 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1795 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:25:39.460275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:39.460999 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:39.466671 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.467116 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:39.467868 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.468294 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:39.492438 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:39.493040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:39.499384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.499904 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:39.500885 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.501766 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:39.679954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:39.687550 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-dcce2840-88c5-432f-b47f-af255ae3dc71 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.230887 Jul 27 15:25:39.696706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 351/726] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:39 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:39.697449 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:39.699271 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-416fcb0b-0f75-488e-85d4-eb9c5d7c0e4c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1508 microversion: 2.1 time: 0.210590 Jul 27 15:25:39.699828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 376/727] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:39 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:39.893283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:39.893917 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:39.899791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.900235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:39.901002 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:39.901429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:40.040891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:40.048563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2c173be1-314e-4488-84cd-8c883818c363 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.159374 Jul 27 15:25:40.049246 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 352/728] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:39 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:40.704238 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:40.704853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:40.710649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:40.711449 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:40.712224 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:40.712664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:40.715929 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:40.716590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:40.722245 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:40.722740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:40.723515 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:40.723950 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:40.913890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:40.916915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:40.921780 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-dda0b990-1808-47c0-acb5-91fd1f5b520a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.221021 Jul 27 15:25:40.922730 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 377/729] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:40 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:40.925740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a77231bd-9a14-4c6c-acac-cedaf23461dc tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1508 microversion: 2.1 time: 0.213342 Jul 27 15:25:40.926320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 353/730] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:40 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:41.065550 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:41.066096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:41.072010 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:41.072457 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:41.073225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:41.073708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:41.213050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:41.220854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-06bf4adf-b8d8-4944-9429-8c0f09c90b5c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.159033 Jul 27 15:25:41.221415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 378/731] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:41 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:41.940014 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:41.940575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:41.941743 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:41.942347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:41.946514 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:41.946971 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:41.947747 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:41.947943 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:41.948161 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:41.948384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:41.949133 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:41.949556 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:42.147154 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:42.151897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:42.154430 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-61ba48b6-3a0d-448c-b27b-85ff0b734a05 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1508 microversion: 2.1 time: 0.216211 Jul 27 15:25:42.155360 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 379/732] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:41 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:42.168628 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-743a322e-553c-4b31-ab6e-c5b3ce42b410 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1358 microversion: 2.1 time: 0.232599 Jul 27 15:25:42.169205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 354/733] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:41 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:42.240850 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:42.241804 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:42.247695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:42.248139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:42.248903 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:42.249335 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:42.383971 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:42.391524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1d749b75-a5af-4c5b-939b-f0b77cb75016 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.154187 Jul 27 15:25:42.392434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 380/734] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:42 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:42.846821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-414753009", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "networks": [{"uuid": "dda8cb76-48cd-4061-9465-3f02fa986cfd"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:42.988246 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] validate_networks() for [('dda8cb76-48cd-4061-9465-3f02fa986cfd', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:25:43.172101 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:43.172874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:43.179633 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.180413 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.181266 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.181776 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.596748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:43.603881 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-edfee72f-fd39-444c-9504-bb9638b81193 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1508 microversion: 2.1 time: 0.435713 Jul 27 15:25:43.604474 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 381/735] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:43 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1508 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:43.608622 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:43.609225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:43.615082 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.615560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.616321 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.616750 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.621055 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:25:43.621590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:25:43.622092 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:25:43.622545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:25:43.622960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:25:43.632095 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.632540 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.633338 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.633771 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.650572 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Getting quotas for project cb8f75cbd1734c8badbc060217f7bc9d. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:25:43.654657 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Getting quotas for user c35a7e69518f46ff9077527e4d810687 and project cb8f75cbd1734c8badbc060217f7bc9d. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:25:43.665573 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:25:43.668166 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:25:43.713824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-24b323a2-d375-4728-bf4f-a70f27568b27 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871243 Jul 27 15:25:43.719363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 355/736] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:25:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:25:43.719363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:43.719866 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:43.725474 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.725921 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.726717 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.727149 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.766976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:43.774507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e2b37228-8c1d-4bc3-9a2b-673b91e14688 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1547 microversion: 2.1 time: 0.169045 Jul 27 15:25:43.775086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 382/737] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:43 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:43.779511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9f41add2-0c51-4486-9416-3c7b7dc3bfbc tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:43.780119 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9f41add2-0c51-4486-9416-3c7b7dc3bfbc tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:43.849212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9f41add2-0c51-4486-9416-3c7b7dc3bfbc tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:43.857119 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9f41add2-0c51-4486-9416-3c7b7dc3bfbc tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1218 microversion: 2.1 time: 0.080690 Jul 27 15:25:43.857706 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 383/738] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:43 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:43.869655 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:43.870969 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:43.882728 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.883268 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.884153 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:43.884600 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:43.931131 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:43.939995 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-526099b5-c0f4-4396-b686-c78384d18a9a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.224515 Jul 27 15:25:43.940812 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 356/739] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:43 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:44.050241 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:44.062264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-095cfb59-8c39-4ee7-8bb2-414d6989cd8d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1547 microversion: 2.1 time: 0.202585 Jul 27 15:25:44.063018 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 384/740] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:43 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1547 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:44.077765 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:44.081147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:44.081147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:25:44.082383 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:44.083365 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Searching by: {'deleted': False, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c'} {{(pid=107333) get_all /opt/stack/nova/nova/compute/api.py:2833}} Jul 27 15:25:44.090716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.091163 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.092124 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.092862 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.191952 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.multi_cell_list [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107333) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 27 15:25:44.297407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c55ba532-077a-4fc5-9576-dcb014cb5370 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.223057 Jul 27 15:25:44.298026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 357/741] 10.222.0.37 () {58 vars in 1125 bytes} [Tue Jul 27 15:25:44 2021] GET /compute/v2.1/servers => generated 343 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:44.307982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:44.308606 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:44.314695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.315151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.316104 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.316561 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.554075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:44.561776 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-44de240b-09a2-411e-bdc7-9c41a900b90e tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1547 microversion: 2.1 time: 0.257346 Jul 27 15:25:44.573695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 385/742] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:44 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1547 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:44.620150 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:44.621025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:44.628571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.629253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.630269 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.631001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.848084 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:44.867900 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6edc3919-6e44-4bcb-b9e3-fa2e293b7973 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 200 len: 1508 microversion: 2.1 time: 0.250861 Jul 27 15:25:44.873226 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:44.873867 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:44.882691 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 358/743] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:44 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:44.895571 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.901040 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.902358 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.903041 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.955232 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-7605a89a-9735-41b0-add1-56056fa1d1c1 req-0797d2e4-7e75-4fb4-aa6f-9a1b604355af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a264be-9867-41ed-8a97-19899b508639", "name": "network-vif-deleted", "tag": "2f28d58b-d9e8-4f6b-84d0-a16d154fe9ba"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:44.956757 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:44.956757 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:25:44.974118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-7605a89a-9735-41b0-add1-56056fa1d1c1 req-0797d2e4-7e75-4fb4-aa6f-9a1b604355af service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:44.974588 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-7605a89a-9735-41b0-add1-56056fa1d1c1 req-0797d2e4-7e75-4fb4-aa6f-9a1b604355af service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:44.995547 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-7605a89a-9735-41b0-add1-56056fa1d1c1 req-0797d2e4-7e75-4fb4-aa6f-9a1b604355af service nova] Creating event network-vif-deleted:2f28d58b-d9e8-4f6b-84d0-a16d154fe9ba for instance 49a264be-9867-41ed-8a97-19899b508639 on hv-cinder-80043 Jul 27 15:25:45.017570 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-7605a89a-9735-41b0-add1-56056fa1d1c1 req-0797d2e4-7e75-4fb4-aa6f-9a1b604355af service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067821 Jul 27 15:25:45.019142 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 359/744] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:25:45.031594 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:45.032203 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:45.032815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:45.039670 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:45.040545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:45.041946 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:45.042156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-686920db-3c43-4340-9563-93d5d8b31bf5 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1270 microversion: 2.1 time: 0.172500 Jul 27 15:25:45.043179 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:45.043295 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 386/745] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:44 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:45.231618 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:45.241103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cc22cdbc-6010-41b7-81db-002551b7f4fc tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.218529 Jul 27 15:25:45.241699 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 360/746] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:45 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:45.900432 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:45.901106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 49a264be-9867-41ed-8a97-19899b508639] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:45.915064 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:45.915943 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:45.918007 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:45.918710 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:45.941795 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] HTTP exception thrown: Instance 49a264be-9867-41ed-8a97-19899b508639 could not be found. Jul 27 15:25:45.942584 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Returning 404 to user: Instance 49a264be-9867-41ed-8a97-19899b508639 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:25:45.943601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-eed0a037-46e6-4300-9316-d178a3d4ac17 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639" status: 404 len: 111 microversion: 2.1 time: 0.047207 Jul 27 15:25:45.944316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 387/747] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:45 2021] GET /compute/v2.1/servers/49a264be-9867-41ed-8a97-19899b508639 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:25:45.952489 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:45.953016 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:45.959827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:45.960281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:45.961062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:45.961507 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:45.988690 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:25:46.060560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:46.061595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:46.071723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.072422 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.073282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.073912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.096457 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8d9c59a4-ef05-40e3-af73-d8561cfe7540 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 204 len: 0 microversion: 2.1 time: 0.147560 Jul 27 15:25:46.099983 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 361/748] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:25:45 2021] DELETE /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:25:46.108046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:46.108991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:46.115638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.116299 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.117223 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.117906 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.298330 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:46.306251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-aadd3271-0fc1-4df1-b62d-7f78949090cf tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1318 microversion: 2.1 time: 0.249867 Jul 27 15:25:46.307049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 388/749] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:46 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:46.311808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ea56602a-03d7-4e12-9b90-e65377d6c56d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1d18036-89b0-4718-adeb-e12493a0bdf5"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:46.312906 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ea56602a-03d7-4e12-9b90-e65377d6c56d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:46.318677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea56602a-03d7-4e12-9b90-e65377d6c56d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.319336 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea56602a-03d7-4e12-9b90-e65377d6c56d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.320278 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea56602a-03d7-4e12-9b90-e65377d6c56d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.320880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ea56602a-03d7-4e12-9b90-e65377d6c56d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.325487 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:46.333605 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-65c0afda-886f-405d-9ec6-2061bb675478 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.229284 Jul 27 15:25:46.341296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 362/750] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:46 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:46.348211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:46.348924 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:46.355875 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.356328 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.357104 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:46.357538 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:46.513306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:46.523131 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-953cf891-b67b-4d23-8ca8-e0fe6963217e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1679 microversion: 2.1 time: 0.180251 Jul 27 15:25:46.526565 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 363/751] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:46 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:46.615897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ea56602a-03d7-4e12-9b90-e65377d6c56d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306999 Jul 27 15:25:46.616136 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 389/752] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:25:46 2021] POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:47.034852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-9c306224-80e1-48e9-968c-64f74693df56 req-c554769e-2423-45f3-96f4-c29dc8c14360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83ca12ec-677d-43ca-8e04-252a7b458701", "tag": "a4876f83-213f-41f4-b79e-975ccac654eb"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:47.036348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:47.036348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:25:47.043206 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-9c306224-80e1-48e9-968c-64f74693df56 req-c554769e-2423-45f3-96f4-c29dc8c14360 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.043653 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-9c306224-80e1-48e9-968c-64f74693df56 req-c554769e-2423-45f3-96f4-c29dc8c14360 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.054817 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-9c306224-80e1-48e9-968c-64f74693df56 req-c554769e-2423-45f3-96f4-c29dc8c14360 service nova] Creating event network-changed:a4876f83-213f-41f4-b79e-975ccac654eb for instance 83ca12ec-677d-43ca-8e04-252a7b458701 on hv-cinder-80043 Jul 27 15:25:47.059436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-9c306224-80e1-48e9-968c-64f74693df56 req-c554769e-2423-45f3-96f4-c29dc8c14360 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028714 Jul 27 15:25:47.060038 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 364/753] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:47.324050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:47.324900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:47.331941 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.332451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.333319 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.333842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.354740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:47.356379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:47.363228 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.363927 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.381444 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.382072 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.514863 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:47.524265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c4aca1b3-2794-4c97-94cc-027c034e1516 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1318 microversion: 2.1 time: 0.204262 Jul 27 15:25:47.524837 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 390/754] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:47 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:47.540793 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:47.541662 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:47.548603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.548814 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.549615 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.550072 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.595308 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:47.603162 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-19522181-7754-4abb-821c-c0f65df6bea1 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.256536 Jul 27 15:25:47.615105 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 365/755] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:47 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:47.698456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:47.707002 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b8d8b18a-6a28-4278-876d-0865563e6ec7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1656 microversion: 2.1 time: 0.170582 Jul 27 15:25:47.707577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 391/756] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:47 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:47.723336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a9349bcf-4f24-4d15-9dc3-ddc05bc69dc3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:47.729078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a9349bcf-4f24-4d15-9dc3-ddc05bc69dc3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.729691 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a9349bcf-4f24-4d15-9dc3-ddc05bc69dc3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.751947 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a9349bcf-4f24-4d15-9dc3-ddc05bc69dc3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Going to try to start instance {{(pid=107333) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 27 15:25:47.792374 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a9349bcf-4f24-4d15-9dc3-ddc05bc69dc3 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action" status: 202 len: 0 microversion: 2.1 time: 0.072902 Jul 27 15:25:47.793103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 366/757] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:25:47 2021] POST /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:25:47.801667 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:47.802338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:47.808491 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.809008 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.809792 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:47.810223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:47.987212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:47.994707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5e1f474e-54c0-4122-82e2-b1fbf4935f22 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1665 microversion: 2.1 time: 0.197297 Jul 27 15:25:47.995583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 392/758] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:47 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1665 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:48.543400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:48.545119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:48.551408 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:48.551860 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:48.552666 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:48.553098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:48.636827 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:48.638107 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:48.649669 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:48.650405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:48.651577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:48.652170 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:48.775854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:48.785105 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6aa2c7c9-f6d4-4297-9bd2-d6ee4769d69f tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1318 microversion: 2.1 time: 0.247196 Jul 27 15:25:48.786305 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 367/759] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:48 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:48.869564 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:48.877596 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8dcee5ce-9dbe-4e29-8211-ad5d0023d01b tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.249548 Jul 27 15:25:48.878175 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 393/760] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:48 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:49.012062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:49.012664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:49.018390 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:49.018858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:49.019610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:49.020047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:49.152320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:49.160016 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9d409be1-8ed5-4106-9bfb-733695e6b208 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1665 microversion: 2.1 time: 0.151555 Jul 27 15:25:49.160573 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 368/761] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:49 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:49.801355 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:49.801950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:49.808143 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:49.808583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:49.809341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:49.809773 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:49.895974 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:49.896583 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:49.902247 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:49.902725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:49.903488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:49.904090 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:49.961508 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:49.970059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-de509222-5202-4676-b052-17b3b7f28b0a tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1318 microversion: 2.1 time: 0.171853 Jul 27 15:25:49.970874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 394/762] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:49 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:50.052476 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:50.059638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-97f7bfee-edc8-4f1f-8537-a15a532c9717 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.167269 Jul 27 15:25:50.060191 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 369/763] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:49 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:50.177752 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:50.178354 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:50.184076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:50.184517 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:50.185269 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:50.185692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:50.320685 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:50.327842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-41d40424-e508-4f61-8e74-a3b95c0a2f0a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1669 microversion: 2.1 time: 0.154672 Jul 27 15:25:50.328407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 395/764] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:50 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:50.720554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-f08239fa-9ee9-4a49-8386-964e642f5d5c req-c21a6788-5109-4ce7-9fb3-97148af52e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ca12ec-677d-43ca-8e04-252a7b458701", "name": "network-vif-plugged", "status": "completed", "tag": "a4876f83-213f-41f4-b79e-975ccac654eb"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:50.722158 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:50.722158 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:25:50.729256 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f08239fa-9ee9-4a49-8386-964e642f5d5c req-c21a6788-5109-4ce7-9fb3-97148af52e5e service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:50.729870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f08239fa-9ee9-4a49-8386-964e642f5d5c req-c21a6788-5109-4ce7-9fb3-97148af52e5e service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:50.741975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-f08239fa-9ee9-4a49-8386-964e642f5d5c req-c21a6788-5109-4ce7-9fb3-97148af52e5e service nova] Creating event network-vif-plugged:a4876f83-213f-41f4-b79e-975ccac654eb for instance 83ca12ec-677d-43ca-8e04-252a7b458701 on hv-cinder-80043 Jul 27 15:25:50.747144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-f08239fa-9ee9-4a49-8386-964e642f5d5c req-c21a6788-5109-4ce7-9fb3-97148af52e5e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030814 Jul 27 15:25:50.748161 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 370/765] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:50.987146 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:50.987916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:50.994351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:50.995056 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:50.995902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:50.996405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:51.076693 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:51.077532 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:51.084428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:51.085018 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:51.085896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:51.086435 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:51.186436 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:51.193859 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-71afc2e1-10e5-4adb-984c-7e7fa5b4cb30 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1318 microversion: 2.1 time: 0.210533 Jul 27 15:25:51.203202 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 396/766] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:50 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:51.250831 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:51.258201 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-af759608-639b-4343-9b06-4781a9fe5a91 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.185656 Jul 27 15:25:51.258796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 371/767] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:51 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:52.210663 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:52.211213 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:52.216933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:52.217389 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:52.218155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:52.218631 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:52.275162 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:52.275789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:52.281449 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:52.281896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:52.282695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:52.283133 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:52.416546 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:52.423917 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e9e7006b-8206-45f6-8bf7-84e427e465f1 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1318 microversion: 2.1 time: 0.217078 Jul 27 15:25:52.424580 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 397/768] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:52 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:52.451420 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:52.460076 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3938018e-f34e-4c6b-a653-9b0302954c7c tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.188492 Jul 27 15:25:52.460814 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 372/769] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:52 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:53.440323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:53.440871 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:53.446588 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:53.447042 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:53.447798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:53.448226 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:53.476431 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:53.477058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:53.482870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:53.483313 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:53.484067 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:53.484494 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:53.677825 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:53.686489 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e6cf7ec2-24be-4d1c-a9b6-5a25169babc3 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1507 microversion: 2.1 time: 0.250400 Jul 27 15:25:53.687268 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 398/770] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:53 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:53.703057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-589562c5-79ec-4d53-b237-5faa416c7e16 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "209f157f-1f75-4efb-ac09-e827996d7d30", "device": "/dev/sdb"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:53.704174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-589562c5-79ec-4d53-b237-5faa416c7e16 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:53.710116 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-589562c5-79ec-4d53-b237-5faa416c7e16 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:53.710647 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-589562c5-79ec-4d53-b237-5faa416c7e16 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:53.711460 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-589562c5-79ec-4d53-b237-5faa416c7e16 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:53.711905 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-589562c5-79ec-4d53-b237-5faa416c7e16 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:53.721158 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:53.731340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8f8a9f0b-615a-43be-aec4-df7d25b4af73 tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1521 microversion: 2.1 time: 0.258323 Jul 27 15:25:53.741143 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 373/771] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:53 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:25:53.970506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-589562c5-79ec-4d53-b237-5faa416c7e16 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "POST /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270449 Jul 27 15:25:53.971058 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 399/772] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:25:53 2021] POST /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:25:54.248992 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:54.249605 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:54.255885 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:54.256335 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:54.257113 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:54.257547 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:54.441986 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-32a7825e-6b60-4f78-acbd-ba936817553c req-d68fb850-8492-4b2e-a5a6-c1ece1dbb797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8430fe02-1ac5-4a7b-9332-d299c54fa8b2", "name": "network-vif-deleted", "tag": "c19d7c85-39cc-4b88-9f66-88f0b1054f65"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:54.443763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:54.443763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:25:54.452369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-32a7825e-6b60-4f78-acbd-ba936817553c req-d68fb850-8492-4b2e-a5a6-c1ece1dbb797 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:54.453066 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-32a7825e-6b60-4f78-acbd-ba936817553c req-d68fb850-8492-4b2e-a5a6-c1ece1dbb797 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:54.464803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-32a7825e-6b60-4f78-acbd-ba936817553c req-d68fb850-8492-4b2e-a5a6-c1ece1dbb797 service nova] Creating event network-vif-deleted:c19d7c85-39cc-4b88-9f66-88f0b1054f65 for instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 on hv-cinder-80043 Jul 27 15:25:54.469559 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-32a7825e-6b60-4f78-acbd-ba936817553c req-d68fb850-8492-4b2e-a5a6-c1ece1dbb797 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032443 Jul 27 15:25:54.470183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 400/773] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:25:54.521017 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:54.529608 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-dc127adb-8fcf-46b9-965a-6e5e01a8ffcb tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1593 microversion: 2.1 time: 0.284248 Jul 27 15:25:54.530170 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 374/774] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:54 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1593 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:54.749256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:54.749955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:54.756624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:54.757119 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:54.757937 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:54.758379 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:54.789266 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:54.789718 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:54.790166 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lazy-loading 'fault' on Instance uuid 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:25:54.837919 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24962f23bed4f9dba749445f1e250fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa9a0a21019483cbc4b4f3328f558d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:54.845147 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6985100c-3859-402a-8eaa-428efccc745f tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 200 len: 1311 microversion: 2.1 time: 0.099889 Jul 27 15:25:54.845713 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 401/775] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:54 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:25:55.863330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:55.864450 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] [instance: 8430fe02-1ac5-4a7b-9332-d299c54fa8b2] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:55.870213 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:55.870706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:55.871484 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:55.871934 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:55.885023 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] HTTP exception thrown: Instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 could not be found. Jul 27 15:25:55.885611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] Returning 404 to user: Instance 8430fe02-1ac5-4a7b-9332-d299c54fa8b2 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:25:55.886436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-99d0e2a5-741a-4264-8924-7daa269ff54a tempest-ServerRescueNegativeTestJSON-1309020346 tempest-ServerRescueNegativeTestJSON-1309020346-project] 10.222.0.37 "GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2" status: 404 len: 111 microversion: 2.1 time: 0.028134 Jul 27 15:25:55.886998 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 375/776] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:55 2021] GET /compute/v2.1/servers/8430fe02-1ac5-4a7b-9332-d299c54fa8b2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:25:56.538296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-fd4c4f03-3ae8-42ce-af77-52d1fb27a9c2 req-77281af9-6d7c-44c4-bb43-3d121369622a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09456958-d9aa-49a0-b9ea-f982b7bee9d7", "tag": "0bb393d9-c24e-40b6-91a9-81412447d60f"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:56.538296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:56.538296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:25:56.549097 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-fd4c4f03-3ae8-42ce-af77-52d1fb27a9c2 req-77281af9-6d7c-44c4-bb43-3d121369622a service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:56.549680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-fd4c4f03-3ae8-42ce-af77-52d1fb27a9c2 req-77281af9-6d7c-44c4-bb43-3d121369622a service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:56.561829 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-fd4c4f03-3ae8-42ce-af77-52d1fb27a9c2 req-77281af9-6d7c-44c4-bb43-3d121369622a service nova] Creating event network-changed:0bb393d9-c24e-40b6-91a9-81412447d60f for instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 on hv-cinder-80043 Jul 27 15:25:56.567169 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-fd4c4f03-3ae8-42ce-af77-52d1fb27a9c2 req-77281af9-6d7c-44c4-bb43-3d121369622a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038119 Jul 27 15:25:56.568307 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 402/777] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:57.989414 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-102933022"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:57.989997 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:57.995743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:57.996189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:57.996979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:57.997414 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:58.215351 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.network.security_group_api [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Adding security group c3c8d4cc-9b9b-409b-98d0-909c9247b620 to port 0bb393d9-c24e-40b6-91a9-81412447d60f Jul 27 15:25:58.875903 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-64c7e350-3bae-490f-b812-88e4d4bb87bc tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/action" status: 202 len: 0 microversion: 2.1 time: 0.890207 Jul 27 15:25:58.877443 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 376/778] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:25:57 2021] POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:25:58.886611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:25:58.887996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:25:58.895331 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:58.896181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:58.897196 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:58.897907 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:58.938021 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-fd9b6273-5341-4ac2-9e59-a11a47e2ec94 req-aed9559b-e9b5-41bd-bc17-008764114dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09456958-d9aa-49a0-b9ea-f982b7bee9d7", "tag": "0bb393d9-c24e-40b6-91a9-81412447d60f"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:25:58.940314 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:58.940314 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:25:58.948552 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-fd9b6273-5341-4ac2-9e59-a11a47e2ec94 req-aed9559b-e9b5-41bd-bc17-008764114dc4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:25:58.949513 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-fd9b6273-5341-4ac2-9e59-a11a47e2ec94 req-aed9559b-e9b5-41bd-bc17-008764114dc4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:25:58.966113 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-fd9b6273-5341-4ac2-9e59-a11a47e2ec94 req-aed9559b-e9b5-41bd-bc17-008764114dc4 service nova] Creating event network-changed:0bb393d9-c24e-40b6-91a9-81412447d60f for instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 on hv-cinder-80043 Jul 27 15:25:58.978034 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-fd9b6273-5341-4ac2-9e59-a11a47e2ec94 req-aed9559b-e9b5-41bd-bc17-008764114dc4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042893 Jul 27 15:25:58.979459 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 377/779] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:25:59.490313 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:25:59.499553 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d2b8d530-1d33-47e8-8a30-3b73ed795af7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1757 microversion: 2.1 time: 0.617576 Jul 27 15:25:59.500121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 403/780] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:25:58 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1757 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:16.395663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa5fe9fb-01d5-44db-834e-17c7adfe68ea] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 15:26:16.400540 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:16.401108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:16.407009 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:16.407958 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:16.408725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:16.409152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:16.493698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lazy-loading 'services' on Instance uuid 83ca12ec-677d-43ca-8e04-252a7b458701 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:26:16.558953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-249a687d-fbe0-401e-919a-086bf7c666d0 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "DELETE /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701/os-volume_attachments/209f157f-1f75-4efb-ac09-e827996d7d30" status: 202 len: 0 microversion: 2.1 time: 0.164597 Jul 27 15:26:16.559646 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 378/781] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:26:16 2021] DELETE /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701/os-volume_attachments/209f157f-1f75-4efb-ac09-e827996d7d30 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:26:17.683636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:17.684156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:17.690431 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:17.690912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:17.691677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:17.692112 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:17.716217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:26:17.791458 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1348b100-287d-4a63-8565-71abae418760 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "DELETE /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 204 len: 0 microversion: 2.1 time: 0.110701 Jul 27 15:26:17.792010 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 404/782] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:26:17 2021] DELETE /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:26:17.801084 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:17.801781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:17.820038 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:17.820038 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:17.820038 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:17.820038 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:17.838211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa5fe9fb-01d5-44db-834e-17c7adfe68ea] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 41328. Jul 27 15:26:17.956336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:17.963644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bf6437c8-cf52-4075-9fbf-08e16597d5fd tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1513 microversion: 2.1 time: 0.167117 Jul 27 15:26:17.964212 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 379/783] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:17 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:18.981659 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:18.982277 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:18.988397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:18.988923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:18.989603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:18.990030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:19.138484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:19.147184 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-71f2f3df-f29a-41d4-a0a0-4b162ba56c48 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1513 microversion: 2.1 time: 0.169673 Jul 27 15:26:19.147861 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 405/784] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:18 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:20.164888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:20.165887 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:20.172350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:20.172802 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:20.173634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:20.174008 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:20.399936 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-a93a16c6-6940-4759-b6ff-74f59967d112 req-ad1d05a5-6c95-4236-a08f-55b873a06469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ca12ec-677d-43ca-8e04-252a7b458701", "name": "network-vif-deleted", "tag": "a4876f83-213f-41f4-b79e-975ccac654eb"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:20.401802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:20.401802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:26:20.410416 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-a93a16c6-6940-4759-b6ff-74f59967d112 req-ad1d05a5-6c95-4236-a08f-55b873a06469 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:20.410907 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-a93a16c6-6940-4759-b6ff-74f59967d112 req-ad1d05a5-6c95-4236-a08f-55b873a06469 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:20.423974 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-a93a16c6-6940-4759-b6ff-74f59967d112 req-ad1d05a5-6c95-4236-a08f-55b873a06469 service nova] Creating event network-vif-deleted:a4876f83-213f-41f4-b79e-975ccac654eb for instance 83ca12ec-677d-43ca-8e04-252a7b458701 on hv-cinder-80043 Jul 27 15:26:20.425192 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35a7e69518f46ff9077527e4d810687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f75cbd1734c8badbc060217f7bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:20.429960 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-a93a16c6-6940-4759-b6ff-74f59967d112 req-ad1d05a5-6c95-4236-a08f-55b873a06469 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035380 Jul 27 15:26:20.433665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 406/785] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:26:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:20.439594 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-304f2e73-deb3-4562-9136-f99c842f8e54 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 200 len: 1513 microversion: 2.1 time: 0.278348 Jul 27 15:26:20.440306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 380/786] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:20 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:21.457171 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:21.457870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] [instance: 83ca12ec-677d-43ca-8e04-252a7b458701] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:21.463832 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:21.464288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:21.465053 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:21.465488 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:21.478657 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] HTTP exception thrown: Instance 83ca12ec-677d-43ca-8e04-252a7b458701 could not be found. Jul 27 15:26:21.479232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] Returning 404 to user: Instance 83ca12ec-677d-43ca-8e04-252a7b458701 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:26:21.480030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1784337c-a97f-4d27-bb3f-c5f6ec0e9580 tempest-VolumesSnapshotTestJSON-1823848464 tempest-VolumesSnapshotTestJSON-1823848464-project] 10.222.0.37 "GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701" status: 404 len: 111 microversion: 2.1 time: 0.026862 Jul 27 15:26:21.480652 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 407/787] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:21 2021] GET /compute/v2.1/servers/83ca12ec-677d-43ca-8e04-252a7b458701 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:26:30.720795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3e458852-cc8b-4ea7-9137-0a4135ecc090 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:30.721324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3e458852-cc8b-4ea7-9137-0a4135ecc090 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:30.727132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3e458852-cc8b-4ea7-9137-0a4135ecc090 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:30.727582 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3e458852-cc8b-4ea7-9137-0a4135ecc090 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:30.728347 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3e458852-cc8b-4ea7-9137-0a4135ecc090 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:30.728782 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3e458852-cc8b-4ea7-9137-0a4135ecc090 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:30.757285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3e458852-cc8b-4ea7-9137-0a4135ecc090 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-volume_attachments/46043a9b-1b8e-4785-940c-8bea640cb57e" status: 200 len: 194 microversion: 2.20 time: 0.040222 Jul 27 15:26:30.757842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 381/788] 10.222.0.37 () {60 vars in 1454 bytes} [Tue Jul 27 15:26:30 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-volume_attachments/46043a9b-1b8e-4785-940c-8bea640cb57e => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:26:30.823554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:30.824089 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:30.830205 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:30.830687 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:30.831480 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:30.831918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:30.911842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lazy-loading 'services' on Instance uuid 330a8a79-8995-4ac2-b93f-656f98368132 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:26:30.979730 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d1160fe3-add6-4279-98fd-eeb60abbfff0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-volume_attachments/46043a9b-1b8e-4785-940c-8bea640cb57e" status: 202 len: 0 microversion: 2.20 time: 0.160522 Jul 27 15:26:30.980332 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 408/789] 10.222.0.37 () {60 vars in 1457 bytes} [Tue Jul 27 15:26:30 2021] DELETE /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132/os-volume_attachments/46043a9b-1b8e-4785-940c-8bea640cb57e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:26:35.261386 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:35.261916 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:35.268198 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:35.268706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:35.269466 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:35.269921 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:35.297194 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:26:35.371936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-83e32879-838f-4208-a1fe-4ce25698c2e7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 204 len: 0 microversion: 2.20 time: 0.113890 Jul 27 15:26:35.372562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 382/790] 10.222.0.37 () {60 vars in 1280 bytes} [Tue Jul 27 15:26:35 2021] DELETE /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 15:26:35.383167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:35.384199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:35.391680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:35.392248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:35.393843 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:35.394276 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:35.694056 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:35.701644 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:35.703166 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:35.704312 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4a8dfc78-b95e-48d0-a2fd-81e5c35efb47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.326230 Jul 27 15:26:35.704867 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 409/791] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:35 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:36.723602 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:36.724319 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:36.730042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:36.730614 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:36.731285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:36.731715 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:36.917155 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:36.925028 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:36.926528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:36.928131 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-012c299d-83f9-46ae-a50e-a307841ff9e5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.208848 Jul 27 15:26:36.928244 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 383/792] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:36 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:37.945285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:37.945898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:37.951592 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:37.952042 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:37.952811 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:37.953249 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:38.159952 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:38.167993 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:38.169499 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:38.170661 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3d356694-ffe4-4a0e-a49d-838b853caa06 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1723 microversion: 2.20 time: 0.229070 Jul 27 15:26:38.171223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 410/793] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:37 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:38.697662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-f3efba13-ff3d-4709-b073-49683450b2b1 req-e75828a4-ac7b-4b7d-ba3d-f9d761b6fee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330a8a79-8995-4ac2-b93f-656f98368132", "name": "network-vif-deleted", "tag": "a03d9438-c7a4-446b-884f-370251dd9d3c"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:38.701040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:38.701040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:26:38.709581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f3efba13-ff3d-4709-b073-49683450b2b1 req-e75828a4-ac7b-4b7d-ba3d-f9d761b6fee8 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:38.712490 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f3efba13-ff3d-4709-b073-49683450b2b1 req-e75828a4-ac7b-4b7d-ba3d-f9d761b6fee8 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:38.725626 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-f3efba13-ff3d-4709-b073-49683450b2b1 req-e75828a4-ac7b-4b7d-ba3d-f9d761b6fee8 service nova] Creating event network-vif-deleted:a03d9438-c7a4-446b-884f-370251dd9d3c for instance 330a8a79-8995-4ac2-b93f-656f98368132 on hv-cinder-80043 Jul 27 15:26:38.730664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-f3efba13-ff3d-4709-b073-49683450b2b1 req-e75828a4-ac7b-4b7d-ba3d-f9d761b6fee8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036942 Jul 27 15:26:38.731837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 384/794] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:26:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:39.188463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:39.189181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:39.195833 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:39.196402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:39.197415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:39.197952 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:39.263636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:39.272703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:39.274350 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:39.275629 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4726cf0e-a34f-4636-a293-22cdde9c3670 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1655 microversion: 2.20 time: 0.090929 Jul 27 15:26:39.276557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 411/795] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:39 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:39.979389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bf50288c-c10b-4855-9ab6-8d1d82da9c3f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:39.980407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bf50288c-c10b-4855-9ab6-8d1d82da9c3f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:39.987012 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf50288c-c10b-4855-9ab6-8d1d82da9c3f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:39.987461 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf50288c-c10b-4855-9ab6-8d1d82da9c3f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:39.988245 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf50288c-c10b-4855-9ab6-8d1d82da9c3f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:39.988726 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf50288c-c10b-4855-9ab6-8d1d82da9c3f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:40.065845 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bf50288c-c10b-4855-9ab6-8d1d82da9c3f tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/action" status: 202 len: 0 microversion: 2.1 time: 0.090251 Jul 27 15:26:40.069438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 385/796] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:26:39 2021] POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:26:40.075027 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:40.075705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:40.081568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:40.082011 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:40.082787 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:40.083212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:40.219619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:40.227887 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b25d9338-3e42-4fe2-98c6-ce95a5535d29 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1749 microversion: 2.1 time: 0.156563 Jul 27 15:26:40.228447 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 412/797] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:40 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:26:40.295252 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:40.295948 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:40.302759 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:40.303208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:40.303972 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:40.304404 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:40.368823 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:40.377311 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:40.378963 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:40.380204 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d5e74f2c-1be8-4d29-bf53-2a0cd90a436d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 200 len: 1365 microversion: 2.20 time: 0.089097 Jul 27 15:26:40.380863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 386/798] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:40 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:26:41.245289 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:41.245901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:41.254707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:41.255063 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:41.256030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:41.256612 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:41.398351 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:41.399081 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:41.404949 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:41.405403 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:41.406178 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:41.406654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:41.419854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] HTTP exception thrown: Instance 330a8a79-8995-4ac2-b93f-656f98368132 could not be found. Jul 27 15:26:41.420445 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Returning 404 to user: Instance 330a8a79-8995-4ac2-b93f-656f98368132 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:26:41.421330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7a302e44-2789-40f1-80b4-0d552c0f058f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 404 len: 111 microversion: 2.20 time: 0.027745 Jul 27 15:26:41.421866 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 387/799] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:41 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:26:41.430391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a067822d-14e2-4cf1-9a86-eee967b1a900 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '.version_select at 0x7f33f7790dc0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:41.438122 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:41.446516 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a2769181-33c9-4b17-975f-5923f5d15a84 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1749 microversion: 2.1 time: 0.204922 Jul 27 15:26:41.447161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 413/800] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:41 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1749 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:41.459033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a067822d-14e2-4cf1-9a86-eee967b1a900 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226043852" status: 204 len: 0 microversion: 2.20 time: 0.032054 Jul 27 15:26:41.459590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 388/801] 10.222.0.37 () {60 vars in 1259 bytes} [Tue Jul 27 15:26:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226043852 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 15:26:42.137052 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5f770eb1-8fc9-4d15-b4f4-68070f0f78ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'create', calling method: .version_select at 0x7f33f770aee0>, body: {"keypair": {"name": "tempest-keypair-1406813237"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:42.154372 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5f770eb1-8fc9-4d15-b4f4-68070f0f78ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:26:42.158738 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5f770eb1-8fc9-4d15-b4f4-68070f0f78ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for user d7b9cd998ab149299ffa176bc898c6b2 and project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:26:42.463977 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:42.464593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:42.471119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:42.471574 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:42.472342 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:42.472778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:42.511614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5f770eb1-8fc9-4d15-b4f4-68070f0f78ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:26:42.515705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5f770eb1-8fc9-4d15-b4f4-68070f0f78ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for user d7b9cd998ab149299ffa176bc898c6b2 and project 65683f78756f4210b7c18932064a8ecf. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:26:42.528908 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5f770eb1-8fc9-4d15-b4f4-68070f0f78ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.395599 Jul 27 15:26:42.529686 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 414/802] 10.222.0.37 () {62 vars in 1199 bytes} [Tue Jul 27 15:26:42 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 397 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 27 15:26:42.613117 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:42.622751 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-26f99e6f-1dc2-47a6-a222-4ee27a9109e0 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.162373 Jul 27 15:26:42.623529 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 389/803] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:42 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:26:43.643064 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:43.643785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:43.649502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:43.649946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:43.650746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:43.651178 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:43.768543 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-786401685", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e16a608d-1d8f-4d39-a295-bd2fefb7b802"}], "security_groups": [{"name": "tempest-securitygroup--1443002979"}], "key_name": "tempest-keypair-1406813237", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:43.791543 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:43.799987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3b84fa28-c37b-4c2a-a2f9-6d4f742b5f76 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.160583 Jul 27 15:26:43.800628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 415/804] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:43 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:43.860662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] validate_networks() for [('e16a608d-1d8f-4d39-a295-bd2fefb7b802', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:26:44.273614 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:26:44.274033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:26:44.274535 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:26:44.274948 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:26:44.275358 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:26:44.284358 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:44.284804 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:44.285600 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:44.286029 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:44.302614 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for project 65683f78756f4210b7c18932064a8ecf. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:26:44.306451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Getting quotas for user d7b9cd998ab149299ffa176bc898c6b2 and project 65683f78756f4210b7c18932064a8ecf. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:26:44.320989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:26:44.323278 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:26:44.374441 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e12d16d7-b869-4a68-a6a1-6b182d2aaf3d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.609850 Jul 27 15:26:44.375111 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 390/805] 10.222.0.37 () {62 vars in 1188 bytes} [Tue Jul 27 15:26:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 27 15:26:44.384901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0694a670-b2a3-4882-b714-052a480b0c51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:44.385785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0694a670-b2a3-4882-b714-052a480b0c51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:44.445216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0694a670-b2a3-4882-b714-052a480b0c51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:44.452154 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0694a670-b2a3-4882-b714-052a480b0c51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:44.453634 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0694a670-b2a3-4882-b714-052a480b0c51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:44.454736 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0694a670-b2a3-4882-b714-052a480b0c51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1281 microversion: 2.20 time: 0.073555 Jul 27 15:26:44.455781 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 416/806] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:44 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:44.817577 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:44.818484 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:44.827960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:44.829008 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:44.829350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:44.829817 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:44.972361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:44.980337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1fa3243d-1435-486f-88ea-eb9c59c62b7a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.167264 Jul 27 15:26:44.980968 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 391/807] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:44 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:45.474240 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:45.476072 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:45.483367 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:45.483939 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:45.485752 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:45.486261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:45.555081 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:45.563831 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:45.566018 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:45.567452 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bc8e3b7d-741e-46ee-b631-2bc1620a31c0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1333 microversion: 2.20 time: 0.098585 Jul 27 15:26:45.567998 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 417/808] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:45 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:26:45.998680 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:45.999297 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:46.005698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:46.006162 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:46.006997 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:46.007428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:46.265263 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:46.276396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fe7784b7-d204-47cf-8b22-ba6aafc66af9 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.281618 Jul 27 15:26:46.277048 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 392/809] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:45 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:46.585010 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:46.587923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:46.598304 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:46.598905 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:46.599802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:46.600547 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:47.038722 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:47.047207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:47.049344 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:47.050430 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2e48ef93-bf63-4ad7-a4d0-e7ed6047d63b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.469329 Jul 27 15:26:47.060681 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 418/810] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:46 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:47.293244 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:47.293975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:47.300142 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:47.300685 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:47.301502 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:47.302234 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:47.574282 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:47.583548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9f47f968-15f7-47f0-9522-21429f337a2c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.294235 Jul 27 15:26:47.584387 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 393/811] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:47 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:47.708085 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-1dff2e0c-3d9b-4c31-9ec3-1f4405c080bb req-0db660ee-07aa-450a-9790-ef027d0158a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832", "tag": "b1031221-38f6-4192-a8ea-b6744970a962"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:47.710429 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:47.710429 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:26:47.717923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-1dff2e0c-3d9b-4c31-9ec3-1f4405c080bb req-0db660ee-07aa-450a-9790-ef027d0158a1 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:47.718793 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-1dff2e0c-3d9b-4c31-9ec3-1f4405c080bb req-0db660ee-07aa-450a-9790-ef027d0158a1 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:47.732035 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-1dff2e0c-3d9b-4c31-9ec3-1f4405c080bb req-0db660ee-07aa-450a-9790-ef027d0158a1 service nova] Creating event network-changed:b1031221-38f6-4192-a8ea-b6744970a962 for instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 on hv-cinder-80043 Jul 27 15:26:47.743423 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-1dff2e0c-3d9b-4c31-9ec3-1f4405c080bb req-0db660ee-07aa-450a-9790-ef027d0158a1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041185 Jul 27 15:26:47.744784 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 419/812] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:48.067820 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:48.068552 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:48.074783 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:48.076240 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:48.076960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:48.077398 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:48.294019 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:48.302550 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:48.304037 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:48.305352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f33f2da0-7fa9-41cd-8bd1-f19c166ddf18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.241705 Jul 27 15:26:48.305905 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 394/813] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:48 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:26:48.601533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:48.602392 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:48.612259 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:48.616091 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:48.616987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:48.617617 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:48.941416 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:48.949499 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-60aad503-d5bc-4a9b-935d-9f9881cca405 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.352175 Jul 27 15:26:48.950099 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 420/814] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:48 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:49.323157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:49.324320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:49.330658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.331286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:49.332178 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.333052 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:49.481643 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:49.490454 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:49.492548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:49.493645 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bf31e5c9-cc91-45e0-9511-847decf3e98f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.174356 Jul 27 15:26:49.494196 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 395/815] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:49 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:49.526578 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:49.527075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:49.532709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.533752 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:49.534643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.535073 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:49.559979 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:26:49.639277 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b2df7aff-e981-4ff9-9e80-6fde32948d0b tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 204 len: 0 microversion: 2.1 time: 0.116753 Jul 27 15:26:49.639929 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 421/816] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:26:49 2021] DELETE /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:26:49.648243 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:49.649140 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:49.656277 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.656739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:49.657522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.659280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:49.804390 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:49.812905 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-69a81200-6d8f-46c8-8eeb-a69e5456d005 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1675 microversion: 2.1 time: 0.167802 Jul 27 15:26:49.813662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 396/817] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:49 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:49.967809 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:49.968519 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:49.975131 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.975806 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:49.976746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:49.977181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:50.122128 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:50.130941 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-03428198-3ab0-486c-95df-bc1f34bd2d69 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.167125 Jul 27 15:26:50.131497 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 422/818] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:49 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:50.511105 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:50.511753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:50.518919 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:50.519515 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:50.520454 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:50.520955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:50.662936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:50.670941 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:50.673428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:50.675125 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-eafd0eac-c10a-4641-9d0d-4b29f1f02f66 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.167735 Jul 27 15:26:50.675678 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 397/819] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:50 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:50.840856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:50.841585 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:50.848674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:50.849368 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:50.850145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:50.850617 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:51.008172 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:51.015632 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d680c11f-e278-45af-97db-9de625b2fdbb tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1675 microversion: 2.1 time: 0.179146 Jul 27 15:26:51.016193 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 423/820] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:50 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:51.147600 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:51.148214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:51.153886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:51.154351 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:51.155939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:51.156395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:51.305070 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:51.312884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1d1e89c8-c7c2-484e-8c61-4cd81385ce98 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.168859 Jul 27 15:26:51.313389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 398/821] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:51 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:51.697020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:51.697779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:51.707528 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:51.708492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:51.710110 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:51.710646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:51.848813 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:51.856688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:51.858765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:51.859853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-969afc7d-7a59-4419-a62e-88627bf99858 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.171118 Jul 27 15:26:51.860403 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 424/822] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:51 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:52.033533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:52.034139 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:52.040923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:52.041581 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:52.042365 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:52.042871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:52.267575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:52.279084 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e4236d62-a74f-418e-8cce-b7dcbdfa84b5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1675 microversion: 2.1 time: 0.249583 Jul 27 15:26:52.279673 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 399/823] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:52 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:26:52.329940 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:52.330665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:52.337304 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:52.338071 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:52.339102 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:52.339749 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:52.611610 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:52.628090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-35a83451-f1a5-4263-aef4-f3767a3222cf tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1754 microversion: 2.1 time: 0.301859 Jul 27 15:26:52.628780 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 425/824] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:52 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1754 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:52.877786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:52.878512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:52.884290 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:52.885043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:52.885900 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:52.886404 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:53.124695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:53.133289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:53.134809 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:53.135891 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b597e580-3747-4f2d-a61b-856a4d9e3a51 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.262604 Jul 27 15:26:53.136445 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 400/825] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:52 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:53.217444 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-a97c1024-093d-4f72-87f2-f82cd0551c4f req-9125fb86-c91a-4872-9116-786a0a72bd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b978b7b-a76a-4c2b-94d7-ecdd064ddad3", "name": "network-vif-deleted", "tag": "e6af182d-e796-4b48-bce1-9f47262a90dc"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:53.221439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:53.221439 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:26:53.229253 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-a97c1024-093d-4f72-87f2-f82cd0551c4f req-9125fb86-c91a-4872-9116-786a0a72bd04 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:53.229879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-a97c1024-093d-4f72-87f2-f82cd0551c4f req-9125fb86-c91a-4872-9116-786a0a72bd04 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:53.242556 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-a97c1024-093d-4f72-87f2-f82cd0551c4f req-9125fb86-c91a-4872-9116-786a0a72bd04 service nova] Creating event network-vif-deleted:e6af182d-e796-4b48-bce1-9f47262a90dc for instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 on hv-cinder-80043 Jul 27 15:26:53.262337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-a97c1024-093d-4f72-87f2-f82cd0551c4f req-9125fb86-c91a-4872-9116-786a0a72bd04 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047627 Jul 27 15:26:53.266904 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 426/826] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:26:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:53.296638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:53.297411 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:53.308121 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:53.308821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:53.311177 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:53.313368 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:53.415994 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:53.426975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1d12bb5c-920b-4a32-8c7a-c0a0557ff79f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 200 len: 1323 microversion: 2.1 time: 0.133921 Jul 27 15:26:53.428219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 401/827] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:53 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 1323 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:53.646965 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:53.648671 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:53.656319 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:53.656940 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:53.658865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:53.659456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:53.921210 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:53.942317 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b232dabb-b958-4161-93c8-4ed33dd2257d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1757 microversion: 2.1 time: 0.300885 Jul 27 15:26:53.944194 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 427/828] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:53 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1757 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:53.973211 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-db048eb5-72b6-457b-b58d-1b2128756705 req-4d601d61-078e-4d4d-b903-6b6d55445196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832", "name": "network-vif-plugged", "status": "completed", "tag": "b1031221-38f6-4192-a8ea-b6744970a962"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:53.974823 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:53.974823 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:26:53.982087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-db048eb5-72b6-457b-b58d-1b2128756705 req-4d601d61-078e-4d4d-b903-6b6d55445196 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:53.982771 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-db048eb5-72b6-457b-b58d-1b2128756705 req-4d601d61-078e-4d4d-b903-6b6d55445196 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:53.996408 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-db048eb5-72b6-457b-b58d-1b2128756705 req-4d601d61-078e-4d4d-b903-6b6d55445196 service nova] Creating event network-vif-plugged:b1031221-38f6-4192-a8ea-b6744970a962 for instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 on hv-cinder-80043 Jul 27 15:26:54.003126 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-db048eb5-72b6-457b-b58d-1b2128756705 req-4d601d61-078e-4d4d-b903-6b6d55445196 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033654 Jul 27 15:26:54.003730 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 402/829] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:26:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:54.153333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:54.154096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:54.161668 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:54.162045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:54.162841 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:54.163445 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:54.419182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:54.430832 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:54.432790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:54.434586 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-66599823-5bb0-4cf2-b193-7aeb13d469ed tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.284844 Jul 27 15:26:54.435377 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 428/830] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:54 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:54.450900 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:54.452340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:54.461155 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:54.463821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:54.464537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:54.464972 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:54.493425 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] HTTP exception thrown: Instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 could not be found. Jul 27 15:26:54.494018 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Returning 404 to user: Instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:26:54.494878 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-89b627d4-f8f7-4492-bfa6-8dfd2cb7d656 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 404 len: 111 microversion: 2.1 time: 0.048056 Jul 27 15:26:54.499385 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 403/831] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:54 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:26:54.504237 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ba36427b-f9e4-4997-bc9b-9449b06505e7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '.version_select at 0x7f33f770a1f0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:54.532364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ba36427b-f9e4-4997-bc9b-9449b06505e7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042919463" status: 202 len: 0 microversion: 2.1 time: 0.032052 Jul 27 15:26:54.534273 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 429/832] 10.222.0.37 () {58 vars in 1221 bytes} [Tue Jul 27 15:26:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042919463 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:26:55.453562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:55.454109 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:55.460616 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:55.461069 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:55.461844 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:55.462279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:55.507166 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-29a4dac1-cced-4a6c-a6a1-a7c579478869 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'create', calling method: .version_select at 0x7f33f770ad30>, body: {"keypair": {"name": "tempest-keypair-582518869"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:55.528141 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-29a4dac1-cced-4a6c-a6a1-a7c579478869 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:26:55.532072 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-29a4dac1-cced-4a6c-a6a1-a7c579478869 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for user 02755482dd304f38a78fca1f4a199577 and project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:26:55.607672 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:55.607854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-29a4dac1-cced-4a6c-a6a1-a7c579478869 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:26:55.611312 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-29a4dac1-cced-4a6c-a6a1-a7c579478869 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for user 02755482dd304f38a78fca1f4a199577 and project 601e48ce650f46378322af9bcc36686a. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:26:55.615869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:55.617511 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:55.618822 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9943580b-bae6-4210-ac20-c6a8b55b1562 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1407 microversion: 2.20 time: 0.169849 Jul 27 15:26:55.619474 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 404/833] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:55 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:55.625234 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-29a4dac1-cced-4a6c-a6a1-a7c579478869 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.121758 Jul 27 15:26:55.626302 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 430/834] 10.222.0.37 () {60 vars in 1158 bytes} [Tue Jul 27 15:26:55 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:26:56.636560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:56.637163 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:56.643085 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:56.643531 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:56.644297 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:56.644731 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:56.894113 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:56.902413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:56.903933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:56.905088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fa8c44d3-ff65-48e9-b914-cc6141820817 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1599 microversion: 2.20 time: 0.272250 Jul 27 15:26:56.905848 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 405/835] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:26:56 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1599 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:26:56.923265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-50a3bdc5-5a96-440f-ab8d-e9cbed5086ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:56.923932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-50a3bdc5-5a96-440f-ab8d-e9cbed5086ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:56.929967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50a3bdc5-5a96-440f-ab8d-e9cbed5086ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:56.930524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50a3bdc5-5a96-440f-ab8d-e9cbed5086ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:56.931280 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50a3bdc5-5a96-440f-ab8d-e9cbed5086ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:56.931706 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50a3bdc5-5a96-440f-ab8d-e9cbed5086ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:56.986167 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-787497280", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04c96614-87e6-4ab8-bd19-a70b3ad0e7be"}], "security_groups": [{"name": "tempest-securitygroup--1716573754"}], "key_name": "tempest-keypair-582518869", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:57.027824 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-50a3bdc5-5a96-440f-ab8d-e9cbed5086ec tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108409 Jul 27 15:26:57.028417 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 431/836] 10.222.0.37 () {60 vars in 1316 bytes} [Tue Jul 27 15:26:56 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:26:57.166677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] validate_networks() for [('04c96614-87e6-4ab8-bd19-a70b3ad0e7be', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:26:57.966603 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:26:57.967258 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:26:57.967522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:26:57.967933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:26:57.968345 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:26:57.978825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:57.979275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:57.980235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:57.980671 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:57.997175 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for project 601e48ce650f46378322af9bcc36686a. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:26:58.001209 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Getting quotas for user 02755482dd304f38a78fca1f4a199577 and project 601e48ce650f46378322af9bcc36686a. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:26:58.013728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:26:58.016086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:26:58.061237 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-216cee28-137e-4241-ba64-3e3437f51d53 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.079132 Jul 27 15:26:58.061892 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 406/837] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:26:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:26:58.072262 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ce12949e-a686-47cd-9a3f-217df2c98228 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:58.073538 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ce12949e-a686-47cd-9a3f-217df2c98228 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:58.167728 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ce12949e-a686-47cd-9a3f-217df2c98228 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:58.174444 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ce12949e-a686-47cd-9a3f-217df2c98228 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1236 microversion: 2.1 time: 0.105822 Jul 27 15:26:58.175610 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 432/838] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:58 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:58.443182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-f9384d73-3fc6-45ff-abc9-7f4ff9d32da5 req-517126bc-1b37-4fa8-bf58-fabcf02e66dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832", "tag": "b1031221-38f6-4192-a8ea-b6744970a962"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:58.445397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:26:58.445397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:26:58.455150 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-f9384d73-3fc6-45ff-abc9-7f4ff9d32da5 req-517126bc-1b37-4fa8-bf58-fabcf02e66dc service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:58.455841 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-f9384d73-3fc6-45ff-abc9-7f4ff9d32da5 req-517126bc-1b37-4fa8-bf58-fabcf02e66dc service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:58.473345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-f9384d73-3fc6-45ff-abc9-7f4ff9d32da5 req-517126bc-1b37-4fa8-bf58-fabcf02e66dc service nova] Creating event network-changed:b1031221-38f6-4192-a8ea-b6744970a962 for instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 on hv-cinder-80043 Jul 27 15:26:58.478236 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-f9384d73-3fc6-45ff-abc9-7f4ff9d32da5 req-517126bc-1b37-4fa8-bf58-fabcf02e66dc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040268 Jul 27 15:26:58.479231 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 433/839] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:26:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:26:58.669508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-065663a0-4a4c-48c8-97f8-66c511ed43d7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:58.670680 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-065663a0-4a4c-48c8-97f8-66c511ed43d7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:58.677126 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-065663a0-4a4c-48c8-97f8-66c511ed43d7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:58.677571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-065663a0-4a4c-48c8-97f8-66c511ed43d7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:58.678337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-065663a0-4a4c-48c8-97f8-66c511ed43d7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:58.679179 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-065663a0-4a4c-48c8-97f8-66c511ed43d7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:58.765745 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-065663a0-4a4c-48c8-97f8-66c511ed43d7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.339971 Jul 27 15:26:58.769300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 407/840] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:26:58 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:59.194624 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:26:59.196506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:59.205200 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:59.205942 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:59.207004 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:59.207645 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:59.391438 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:26:59.401776 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5e33a5af-c12f-4e4a-aa33-d2df9fc1ad4a tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1296 microversion: 2.1 time: 0.212363 Jul 27 15:26:59.417375 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 434/841] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:26:59 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1296 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:26:59.777910 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4c9c5098-c4d5-40de-bd1c-354424c48b74 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:26:59.778871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4c9c5098-c4d5-40de-bd1c-354424c48b74 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:26:59.791340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9c5098-c4d5-40de-bd1c-354424c48b74 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:59.791795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9c5098-c4d5-40de-bd1c-354424c48b74 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:59.792587 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9c5098-c4d5-40de-bd1c-354424c48b74 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:26:59.793026 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c9c5098-c4d5-40de-bd1c-354424c48b74 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:26:59.899646 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4c9c5098-c4d5-40de-bd1c-354424c48b74 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.126107 Jul 27 15:26:59.900406 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 408/842] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:26:59 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:00.422522 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:00.424320 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:00.430211 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:00.431031 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:00.432237 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:00.432847 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:00.600490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:00.609225 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bd56a1f3-5b51-4c0d-9375-8b980abb9bbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1362 microversion: 2.1 time: 0.191433 Jul 27 15:27:00.610070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 435/843] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:00 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:00.911221 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-70d336b6-e97a-47a5-aa89-d0f1b608b8f4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:00.912266 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-70d336b6-e97a-47a5-aa89-d0f1b608b8f4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:00.927684 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70d336b6-e97a-47a5-aa89-d0f1b608b8f4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:00.928069 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70d336b6-e97a-47a5-aa89-d0f1b608b8f4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:00.929033 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70d336b6-e97a-47a5-aa89-d0f1b608b8f4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:00.929588 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70d336b6-e97a-47a5-aa89-d0f1b608b8f4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:00.997597 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-3f7b41b0-fac3-4e71-b00e-ed46ec5c9977 req-226aae93-be57-4c97-a747-c7c8dd158e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7341803b-a406-4c1c-92e5-9d285e1953db", "tag": "d0968775-43eb-4c43-81b7-a42592c816ca"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:00.999303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:00.999303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:27:01.011143 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-3f7b41b0-fac3-4e71-b00e-ed46ec5c9977 req-226aae93-be57-4c97-a747-c7c8dd158e32 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:01.011835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-3f7b41b0-fac3-4e71-b00e-ed46ec5c9977 req-226aae93-be57-4c97-a747-c7c8dd158e32 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:01.027451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-3f7b41b0-fac3-4e71-b00e-ed46ec5c9977 req-226aae93-be57-4c97-a747-c7c8dd158e32 service nova] Creating event network-changed:d0968775-43eb-4c43-81b7-a42592c816ca for instance 7341803b-a406-4c1c-92e5-9d285e1953db on hv-cinder-80043 Jul 27 15:27:01.033689 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-3f7b41b0-fac3-4e71-b00e-ed46ec5c9977 req-226aae93-be57-4c97-a747-c7c8dd158e32 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256860 Jul 27 15:27:01.035680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-70d336b6-e97a-47a5-aa89-d0f1b608b8f4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.128965 Jul 27 15:27:01.035858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 409/844] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:27:01.036900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 436/845] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:00 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:27:01.633109 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:01.634006 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:01.640575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:01.641147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:01.642096 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:01.642613 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:01.795102 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:01.803275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-decc3393-fab0-45c1-b498-26eaaf3cfec9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1362 microversion: 2.1 time: 0.174635 Jul 27 15:27:01.803840 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 410/846] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:01 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:02.047843 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-10d9043a-94b5-41d7-b08b-1ee64ae1caf2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:02.049449 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-10d9043a-94b5-41d7-b08b-1ee64ae1caf2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:02.055948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d9043a-94b5-41d7-b08b-1ee64ae1caf2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:02.056389 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d9043a-94b5-41d7-b08b-1ee64ae1caf2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:02.057156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d9043a-94b5-41d7-b08b-1ee64ae1caf2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:02.057732 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d9043a-94b5-41d7-b08b-1ee64ae1caf2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:02.145636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-10d9043a-94b5-41d7-b08b-1ee64ae1caf2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.101812 Jul 27 15:27:02.146524 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 437/847] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:02 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:02.820048 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:02.820663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:02.826321 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:02.826794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:02.827548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:02.827973 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:02.969575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:02.976813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-79d33f85-86a0-453d-bc54-535df40554b8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1362 microversion: 2.1 time: 0.160311 Jul 27 15:27:02.977455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 411/848] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:02 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:03.157489 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-12ccf697-3fd3-40f0-96c3-09c5bc7d319e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:03.158482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-12ccf697-3fd3-40f0-96c3-09c5bc7d319e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:03.165548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12ccf697-3fd3-40f0-96c3-09c5bc7d319e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:03.166074 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12ccf697-3fd3-40f0-96c3-09c5bc7d319e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:03.166953 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12ccf697-3fd3-40f0-96c3-09c5bc7d319e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:03.167448 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12ccf697-3fd3-40f0-96c3-09c5bc7d319e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:03.253764 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-12ccf697-3fd3-40f0-96c3-09c5bc7d319e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.100156 Jul 27 15:27:03.254507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 438/849] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:03 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:03.992813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:03.993429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:03.999716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:04.000176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:04.000957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:04.001900 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:04.146518 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:04.154621 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fdb8239c-0aa9-482f-a384-28ff98e9da74 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1362 microversion: 2.1 time: 0.164977 Jul 27 15:27:04.154922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 412/850] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:03 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:04.264842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a84b02f5-5183-4f28-8b8b-ce25688f057f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:04.265846 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a84b02f5-5183-4f28-8b8b-ce25688f057f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:04.272783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a84b02f5-5183-4f28-8b8b-ce25688f057f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:04.273226 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a84b02f5-5183-4f28-8b8b-ce25688f057f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:04.273992 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a84b02f5-5183-4f28-8b8b-ce25688f057f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:04.274420 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a84b02f5-5183-4f28-8b8b-ce25688f057f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:04.359339 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a84b02f5-5183-4f28-8b8b-ce25688f057f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.098251 Jul 27 15:27:04.360232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 439/851] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:04 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:05.170458 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:05.171264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:05.177131 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:05.177686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:05.178488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:05.178926 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:05.314382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:05.322302 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6e525b91-002c-4c12-b0fd-cc1f4cec5922 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1362 microversion: 2.1 time: 0.155349 Jul 27 15:27:05.322932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 413/852] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:05 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:05.371108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6ad1fe53-6382-4e6e-b033-8180b3114c6d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:05.372095 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6ad1fe53-6382-4e6e-b033-8180b3114c6d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:05.378670 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ad1fe53-6382-4e6e-b033-8180b3114c6d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:05.379129 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ad1fe53-6382-4e6e-b033-8180b3114c6d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:05.379901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ad1fe53-6382-4e6e-b033-8180b3114c6d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:05.380341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ad1fe53-6382-4e6e-b033-8180b3114c6d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:05.475584 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6ad1fe53-6382-4e6e-b033-8180b3114c6d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.108532 Jul 27 15:27:05.476316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 440/853] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:05 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:05.744154 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-cadd7e14-3283-4406-baea-e92df5c8e33f req-002ad049-b632-4ee8-8393-163a64669bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7341803b-a406-4c1c-92e5-9d285e1953db", "name": "network-vif-plugged", "status": "completed", "tag": "d0968775-43eb-4c43-81b7-a42592c816ca"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:05.745664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:05.745664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:27:05.752838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-cadd7e14-3283-4406-baea-e92df5c8e33f req-002ad049-b632-4ee8-8393-163a64669bbc service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:05.753275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-cadd7e14-3283-4406-baea-e92df5c8e33f req-002ad049-b632-4ee8-8393-163a64669bbc service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:05.765897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-cadd7e14-3283-4406-baea-e92df5c8e33f req-002ad049-b632-4ee8-8393-163a64669bbc service nova] Creating event network-vif-plugged:d0968775-43eb-4c43-81b7-a42592c816ca for instance 7341803b-a406-4c1c-92e5-9d285e1953db on hv-cinder-80043 Jul 27 15:27:05.770977 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-cadd7e14-3283-4406-baea-e92df5c8e33f req-002ad049-b632-4ee8-8393-163a64669bbc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030949 Jul 27 15:27:05.771572 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 414/854] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:06.340098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:06.341772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:06.348636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:06.349508 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:06.350386 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:06.351182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:06.487344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-273ab9da-86dd-484e-be03-2edc672cbcf9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:06.489059 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-273ab9da-86dd-484e-be03-2edc672cbcf9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:06.495743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-273ab9da-86dd-484e-be03-2edc672cbcf9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:06.496274 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-273ab9da-86dd-484e-be03-2edc672cbcf9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:06.497296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-273ab9da-86dd-484e-be03-2edc672cbcf9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:06.497931 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-273ab9da-86dd-484e-be03-2edc672cbcf9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:06.508080 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:06.516895 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c9455699-77ce-4961-a399-1c8ae466138f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1362 microversion: 2.1 time: 0.180802 Jul 27 15:27:06.518455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 441/855] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:06 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:06.631374 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-273ab9da-86dd-484e-be03-2edc672cbcf9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.148266 Jul 27 15:27:06.632244 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 415/856] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:06 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:27:07.534767 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:07.535373 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:07.546232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:07.546957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:07.547961 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:07.548401 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:07.643276 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-eeb9970a-0c7d-4443-a778-d66620b63376 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:07.644843 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-eeb9970a-0c7d-4443-a778-d66620b63376 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:07.651476 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eeb9970a-0c7d-4443-a778-d66620b63376 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:07.651919 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eeb9970a-0c7d-4443-a778-d66620b63376 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:07.652917 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eeb9970a-0c7d-4443-a778-d66620b63376 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:07.653660 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eeb9970a-0c7d-4443-a778-d66620b63376 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:07.744871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-eeb9970a-0c7d-4443-a778-d66620b63376 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 14 microversion: 2.20 time: 0.106098 Jul 27 15:27:07.745427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 416/857] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:07 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:27:07.833883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:07.841747 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b544116d-c389-4766-be05-f00fe65ce196 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1362 microversion: 2.1 time: 0.310675 Jul 27 15:27:07.842441 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 442/858] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:07 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:08.756973 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e4e0030e-445c-4a34-acf5-3308733b34e2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:08.758731 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e4e0030e-445c-4a34-acf5-3308733b34e2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:08.765360 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4e0030e-445c-4a34-acf5-3308733b34e2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:08.765822 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4e0030e-445c-4a34-acf5-3308733b34e2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:08.766633 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4e0030e-445c-4a34-acf5-3308733b34e2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:08.772884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e4e0030e-445c-4a34-acf5-3308733b34e2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:08.859511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:08.860835 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:08.868661 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:08.870021 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:08.871246 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:08.871888 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:08.881425 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e4e0030e-445c-4a34-acf5-3308733b34e2 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 8354 microversion: 2.20 time: 0.127736 Jul 27 15:27:08.883884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 417/859] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:08 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 8354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:09.160347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:09.168535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0226c170-1e93-4429-8814-ebdd8a8e3e3c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1549 microversion: 2.1 time: 0.314193 Jul 27 15:27:09.169891 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 443/860] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:08 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1549 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:09.188142 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d2ab9b85-ba13-4dbd-9712-21a0cd663a94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:09.188724 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d2ab9b85-ba13-4dbd-9712-21a0cd663a94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:09.195480 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d2ab9b85-ba13-4dbd-9712-21a0cd663a94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:09.195932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d2ab9b85-ba13-4dbd-9712-21a0cd663a94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:09.196728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d2ab9b85-ba13-4dbd-9712-21a0cd663a94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:09.197160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d2ab9b85-ba13-4dbd-9712-21a0cd663a94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:09.300901 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d2ab9b85-ba13-4dbd-9712-21a0cd663a94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119575 Jul 27 15:27:09.301616 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 418/861] 10.222.0.37 () {58 vars in 1275 bytes} [Tue Jul 27 15:27:09 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:09.894740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d3d4481f-1864-4d2d-8460-96e7bfe1f946 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:09.895643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d3d4481f-1864-4d2d-8460-96e7bfe1f946 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:09.908772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d3d4481f-1864-4d2d-8460-96e7bfe1f946 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:09.911215 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d3d4481f-1864-4d2d-8460-96e7bfe1f946 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:09.912456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d3d4481f-1864-4d2d-8460-96e7bfe1f946 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:09.913088 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d3d4481f-1864-4d2d-8460-96e7bfe1f946 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:10.024178 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d3d4481f-1864-4d2d-8460-96e7bfe1f946 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 16196 microversion: 2.20 time: 0.133294 Jul 27 15:27:10.025886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 444/862] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:09 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 16196 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:10.962348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a719bac9-751c-4f12-8b92-ed9294faf253 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:10.964164 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a719bac9-751c-4f12-8b92-ed9294faf253 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:10.976108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a719bac9-751c-4f12-8b92-ed9294faf253 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:10.976557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a719bac9-751c-4f12-8b92-ed9294faf253 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:10.979298 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a719bac9-751c-4f12-8b92-ed9294faf253 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:10.979735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a719bac9-751c-4f12-8b92-ed9294faf253 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:11.111620 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a719bac9-751c-4f12-8b92-ed9294faf253 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.153097 Jul 27 15:27:11.115363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 419/863] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:10 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:11.124353 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6f5accc9-8a9a-4c05-b668-2dbb526461cf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:11.125574 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6f5accc9-8a9a-4c05-b668-2dbb526461cf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:11.142843 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f5accc9-8a9a-4c05-b668-2dbb526461cf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:11.145480 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f5accc9-8a9a-4c05-b668-2dbb526461cf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:11.146333 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f5accc9-8a9a-4c05-b668-2dbb526461cf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:11.147228 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f5accc9-8a9a-4c05-b668-2dbb526461cf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:11.232984 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-1c8382bb-f999-4faa-aa12-94aaeb4c4d1c req-63e1ec0c-1db9-4e29-8649-57b655d4b005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7341803b-a406-4c1c-92e5-9d285e1953db", "tag": "d0968775-43eb-4c43-81b7-a42592c816ca"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:11.234493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:11.234493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:27:11.246237 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-1c8382bb-f999-4faa-aa12-94aaeb4c4d1c req-63e1ec0c-1db9-4e29-8649-57b655d4b005 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:11.249148 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-1c8382bb-f999-4faa-aa12-94aaeb4c4d1c req-63e1ec0c-1db9-4e29-8649-57b655d4b005 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:11.264959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-1c8382bb-f999-4faa-aa12-94aaeb4c4d1c req-63e1ec0c-1db9-4e29-8649-57b655d4b005 service nova] Creating event network-changed:d0968775-43eb-4c43-81b7-a42592c816ca for instance 7341803b-a406-4c1c-92e5-9d285e1953db on hv-cinder-80043 Jul 27 15:27:11.276939 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-1c8382bb-f999-4faa-aa12-94aaeb4c4d1c req-63e1ec0c-1db9-4e29-8649-57b655d4b005 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313598 Jul 27 15:27:11.277772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 445/864] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:11.283278 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6f5accc9-8a9a-4c05-b668-2dbb526461cf tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 18356 microversion: 2.20 time: 0.162798 Jul 27 15:27:11.284419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 420/865] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:11 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 18356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:12.132848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c17affa2-da91-4bdf-8dd3-31894b991915 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:12.141466 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c17affa2-da91-4bdf-8dd3-31894b991915 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:12.152030 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c17affa2-da91-4bdf-8dd3-31894b991915 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:12.152887 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c17affa2-da91-4bdf-8dd3-31894b991915 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:12.153825 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c17affa2-da91-4bdf-8dd3-31894b991915 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:12.154407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c17affa2-da91-4bdf-8dd3-31894b991915 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:12.250009 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c17affa2-da91-4bdf-8dd3-31894b991915 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.123069 Jul 27 15:27:12.255363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 446/866] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:12 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:12.297188 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-333aaec2-961c-4497-b398-204d5198330a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:12.298183 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-333aaec2-961c-4497-b398-204d5198330a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:12.309463 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-333aaec2-961c-4497-b398-204d5198330a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:12.309904 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-333aaec2-961c-4497-b398-204d5198330a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:12.310991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-333aaec2-961c-4497-b398-204d5198330a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:12.311660 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-333aaec2-961c-4497-b398-204d5198330a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:12.420678 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-333aaec2-961c-4497-b398-204d5198330a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 20757 microversion: 2.20 time: 0.128561 Jul 27 15:27:12.421373 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 421/867] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:12 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 20757 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:13.266263 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-091ab6b6-d0ae-4512-b2ea-3969f3d5482d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:13.268049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-091ab6b6-d0ae-4512-b2ea-3969f3d5482d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:13.274955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-091ab6b6-d0ae-4512-b2ea-3969f3d5482d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:13.275619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-091ab6b6-d0ae-4512-b2ea-3969f3d5482d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:13.276587 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-091ab6b6-d0ae-4512-b2ea-3969f3d5482d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:13.277192 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-091ab6b6-d0ae-4512-b2ea-3969f3d5482d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:13.372289 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-091ab6b6-d0ae-4512-b2ea-3969f3d5482d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.109782 Jul 27 15:27:13.376769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 447/868] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:13 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:13.433785 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6a8b223d-cfe4-4b6f-b5b4-5068df43a266 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:13.435525 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6a8b223d-cfe4-4b6f-b5b4-5068df43a266 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:13.444195 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a8b223d-cfe4-4b6f-b5b4-5068df43a266 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:13.444948 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a8b223d-cfe4-4b6f-b5b4-5068df43a266 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:13.446516 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a8b223d-cfe4-4b6f-b5b4-5068df43a266 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:13.447173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6a8b223d-cfe4-4b6f-b5b4-5068df43a266 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:13.554963 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6a8b223d-cfe4-4b6f-b5b4-5068df43a266 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 22759 microversion: 2.20 time: 0.125053 Jul 27 15:27:13.555786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 422/869] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:13 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 22759 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:14.384566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-26d33424-854e-4b81-8700-7b2a65020120 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:14.385946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-26d33424-854e-4b81-8700-7b2a65020120 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:14.398566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d33424-854e-4b81-8700-7b2a65020120 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:14.399265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d33424-854e-4b81-8700-7b2a65020120 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:14.400182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d33424-854e-4b81-8700-7b2a65020120 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:14.400705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d33424-854e-4b81-8700-7b2a65020120 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:14.502529 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-26d33424-854e-4b81-8700-7b2a65020120 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.122011 Jul 27 15:27:14.503705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 448/870] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:14 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:14.567623 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3a34e88a-c78a-422d-b3f5-722a9bed09f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:14.570023 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3a34e88a-c78a-422d-b3f5-722a9bed09f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:14.578438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a34e88a-c78a-422d-b3f5-722a9bed09f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:14.578914 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a34e88a-c78a-422d-b3f5-722a9bed09f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:14.580227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a34e88a-c78a-422d-b3f5-722a9bed09f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:14.580686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a34e88a-c78a-422d-b3f5-722a9bed09f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:14.687932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3a34e88a-c78a-422d-b3f5-722a9bed09f5 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 23797 microversion: 2.20 time: 0.124101 Jul 27 15:27:14.690219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 423/871] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:14 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 23797 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:15.452935 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-dc1177fe-7c32-47cf-96bc-23d0831739c5 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Action: 'create', calling method: .version_select at 0x7f33f7732f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2028062658"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:15.471481 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-dc1177fe-7c32-47cf-96bc-23d0831739c5 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for project e9a65d475c9846dfabea23794dd2e636. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:27:15.475874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-dc1177fe-7c32-47cf-96bc-23d0831739c5 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for user 56acc4e200664d4b850d1f84a946e576 and project e9a65d475c9846dfabea23794dd2e636. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:27:15.513850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7bd088d6-5966-42d1-878a-c1cbae5a8ccf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:15.515039 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7bd088d6-5966-42d1-878a-c1cbae5a8ccf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:15.523455 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7bd088d6-5966-42d1-878a-c1cbae5a8ccf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:15.524127 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7bd088d6-5966-42d1-878a-c1cbae5a8ccf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:15.525075 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7bd088d6-5966-42d1-878a-c1cbae5a8ccf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:15.525600 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7bd088d6-5966-42d1-878a-c1cbae5a8ccf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:15.618918 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7bd088d6-5966-42d1-878a-c1cbae5a8ccf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.109021 Jul 27 15:27:15.620400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 424/872] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:15 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:27:15.702397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ce46e2eb-7b30-4136-827a-7babfc513050 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:15.704208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ce46e2eb-7b30-4136-827a-7babfc513050 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:15.711552 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce46e2eb-7b30-4136-827a-7babfc513050 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:15.712204 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce46e2eb-7b30-4136-827a-7babfc513050 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:15.713407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce46e2eb-7b30-4136-827a-7babfc513050 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:15.714146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ce46e2eb-7b30-4136-827a-7babfc513050 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:15.740969 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-dc1177fe-7c32-47cf-96bc-23d0831739c5 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for project e9a65d475c9846dfabea23794dd2e636. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:27:15.745041 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-dc1177fe-7c32-47cf-96bc-23d0831739c5 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for user 56acc4e200664d4b850d1f84a946e576 and project e9a65d475c9846dfabea23794dd2e636. Resources: {'key_pairs'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:27:15.760189 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-dc1177fe-7c32-47cf-96bc-23d0831739c5 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.415878 Jul 27 15:27:15.760788 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 449/873] 10.222.0.37 () {60 vars in 1158 bytes} [Tue Jul 27 15:27:15 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:27:15.828583 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ce46e2eb-7b30-4136-827a-7babfc513050 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 25289 microversion: 2.20 time: 0.131639 Jul 27 15:27:15.830344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 425/874] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:15 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 25289 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:16.631033 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-26d43eae-908f-4017-b000-24c3887bf6a5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:16.632212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-26d43eae-908f-4017-b000-24c3887bf6a5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:16.644481 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d43eae-908f-4017-b000-24c3887bf6a5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:16.645232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d43eae-908f-4017-b000-24c3887bf6a5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:16.646521 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d43eae-908f-4017-b000-24c3887bf6a5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:16.647364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-26d43eae-908f-4017-b000-24c3887bf6a5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:16.743092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-26d43eae-908f-4017-b000-24c3887bf6a5 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.115910 Jul 27 15:27:16.743514 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 450/875] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:16 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:16.841067 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fc6309b3-8035-4128-ac20-aa9a322a5708 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:16.842270 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fc6309b3-8035-4128-ac20-aa9a322a5708 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:16.851413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fc6309b3-8035-4128-ac20-aa9a322a5708 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:16.851864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fc6309b3-8035-4128-ac20-aa9a322a5708 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:16.852861 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fc6309b3-8035-4128-ac20-aa9a322a5708 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:16.853301 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fc6309b3-8035-4128-ac20-aa9a322a5708 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:16.959438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fc6309b3-8035-4128-ac20-aa9a322a5708 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 26565 microversion: 2.20 time: 0.122230 Jul 27 15:27:16.964570 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 426/876] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:16 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 26565 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:17.754488 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ac1884d0-ea61-468f-91a1-02f11e283b52 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:17.755587 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ac1884d0-ea61-468f-91a1-02f11e283b52 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:17.762013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ac1884d0-ea61-468f-91a1-02f11e283b52 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:17.762601 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ac1884d0-ea61-468f-91a1-02f11e283b52 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:17.763374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ac1884d0-ea61-468f-91a1-02f11e283b52 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:17.763931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ac1884d0-ea61-468f-91a1-02f11e283b52 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:17.864884 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ac1884d0-ea61-468f-91a1-02f11e283b52 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.114874 Jul 27 15:27:17.868148 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 451/877] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:17 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:17.976386 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9360c272-815b-4551-927a-9232d41dbd97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:17.977393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9360c272-815b-4551-927a-9232d41dbd97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:17.984160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9360c272-815b-4551-927a-9232d41dbd97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:17.984561 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9360c272-815b-4551-927a-9232d41dbd97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:17.985377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9360c272-815b-4551-927a-9232d41dbd97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:17.985812 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9360c272-815b-4551-927a-9232d41dbd97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:18.093647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9360c272-815b-4551-927a-9232d41dbd97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 27304 microversion: 2.20 time: 0.121261 Jul 27 15:27:18.097422 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 427/878] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:17 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 27304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:18.876602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b01cb645-cf67-4117-817a-6ebda63284d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:18.877725 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b01cb645-cf67-4117-817a-6ebda63284d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:18.884207 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b01cb645-cf67-4117-817a-6ebda63284d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:18.884605 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b01cb645-cf67-4117-817a-6ebda63284d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:18.885369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b01cb645-cf67-4117-817a-6ebda63284d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:18.885801 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b01cb645-cf67-4117-817a-6ebda63284d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:18.993199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b01cb645-cf67-4117-817a-6ebda63284d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.120638 Jul 27 15:27:18.994341 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 452/879] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:18 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:19.107500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-87624b35-76ac-4a3f-87b4-cfeddc83211a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:19.108548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-87624b35-76ac-4a3f-87b4-cfeddc83211a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:19.115240 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87624b35-76ac-4a3f-87b4-cfeddc83211a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:19.115694 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87624b35-76ac-4a3f-87b4-cfeddc83211a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:19.116475 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87624b35-76ac-4a3f-87b4-cfeddc83211a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:19.116912 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-87624b35-76ac-4a3f-87b4-cfeddc83211a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:19.225410 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-87624b35-76ac-4a3f-87b4-cfeddc83211a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 27776 microversion: 2.20 time: 0.122358 Jul 27 15:27:19.226055 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 428/880] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:19 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 27776 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:20.006862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e5a5d5d8-d64f-468f-9e13-6f959f54b842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:20.007877 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e5a5d5d8-d64f-468f-9e13-6f959f54b842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:20.014710 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a5d5d8-d64f-468f-9e13-6f959f54b842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:20.015454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a5d5d8-d64f-468f-9e13-6f959f54b842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:20.016647 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a5d5d8-d64f-468f-9e13-6f959f54b842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:20.017803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e5a5d5d8-d64f-468f-9e13-6f959f54b842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:20.112393 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e5a5d5d8-d64f-468f-9e13-6f959f54b842 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.112508 Jul 27 15:27:20.113025 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 453/881] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:19 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:20.237854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-928517d2-d811-4780-99b1-6497e3249157 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:20.238951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-928517d2-d811-4780-99b1-6497e3249157 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:20.245332 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-928517d2-d811-4780-99b1-6497e3249157 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:20.245772 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-928517d2-d811-4780-99b1-6497e3249157 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:20.246563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-928517d2-d811-4780-99b1-6497e3249157 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:20.246991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-928517d2-d811-4780-99b1-6497e3249157 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:20.365487 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-928517d2-d811-4780-99b1-6497e3249157 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28053 microversion: 2.20 time: 0.131522 Jul 27 15:27:20.366132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 429/882] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:20 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28053 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:21.123732 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e0e1bc1a-5ef9-4158-b3c1-4e2b9e97db27 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:21.124717 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e0e1bc1a-5ef9-4158-b3c1-4e2b9e97db27 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:21.131126 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0e1bc1a-5ef9-4158-b3c1-4e2b9e97db27 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:21.131569 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0e1bc1a-5ef9-4158-b3c1-4e2b9e97db27 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:21.132317 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0e1bc1a-5ef9-4158-b3c1-4e2b9e97db27 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:21.132741 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e0e1bc1a-5ef9-4158-b3c1-4e2b9e97db27 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:21.237697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e0e1bc1a-5ef9-4158-b3c1-4e2b9e97db27 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 14 microversion: 2.1 time: 0.117778 Jul 27 15:27:21.238322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 454/883] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:21 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 15:27:21.377984 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-045026a1-28c7-4487-ac61-579987989ca9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:21.379152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-045026a1-28c7-4487-ac61-579987989ca9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:21.386050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-045026a1-28c7-4487-ac61-579987989ca9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:21.386684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-045026a1-28c7-4487-ac61-579987989ca9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:21.387582 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-045026a1-28c7-4487-ac61-579987989ca9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:21.388121 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-045026a1-28c7-4487-ac61-579987989ca9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:21.503308 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-045026a1-28c7-4487-ac61-579987989ca9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28196 microversion: 2.20 time: 0.129443 Jul 27 15:27:21.503895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 430/884] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:21 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28196 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:22.248754 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-446bf9c1-f476-4b79-a8a2-cae2f326d201 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:22.249639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-446bf9c1-f476-4b79-a8a2-cae2f326d201 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:22.256921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-446bf9c1-f476-4b79-a8a2-cae2f326d201 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:22.257426 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-446bf9c1-f476-4b79-a8a2-cae2f326d201 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:22.258286 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-446bf9c1-f476-4b79-a8a2-cae2f326d201 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:22.258769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-446bf9c1-f476-4b79-a8a2-cae2f326d201 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:22.357056 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-446bf9c1-f476-4b79-a8a2-cae2f326d201 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 9443 microversion: 2.1 time: 0.112170 Jul 27 15:27:22.357699 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 455/885] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:22 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 9443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:22.515669 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a151b241-7a82-43be-97bb-47d016a1241e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:22.516582 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a151b241-7a82-43be-97bb-47d016a1241e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:22.523647 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a151b241-7a82-43be-97bb-47d016a1241e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:22.524097 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a151b241-7a82-43be-97bb-47d016a1241e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:22.524870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a151b241-7a82-43be-97bb-47d016a1241e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:22.525312 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a151b241-7a82-43be-97bb-47d016a1241e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:22.619826 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a151b241-7a82-43be-97bb-47d016a1241e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28196 microversion: 2.20 time: 0.108167 Jul 27 15:27:22.620695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 431/886] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:22 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28196 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:23.369070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-188cd245-562d-4e65-88f0-4fe896d7a332 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:23.370059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-188cd245-562d-4e65-88f0-4fe896d7a332 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:23.377730 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-188cd245-562d-4e65-88f0-4fe896d7a332 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:23.378316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-188cd245-562d-4e65-88f0-4fe896d7a332 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:23.379162 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-188cd245-562d-4e65-88f0-4fe896d7a332 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:23.379607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-188cd245-562d-4e65-88f0-4fe896d7a332 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:23.473345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-188cd245-562d-4e65-88f0-4fe896d7a332 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 15025 microversion: 2.1 time: 0.108171 Jul 27 15:27:23.477034 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 456/887] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:23 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 15025 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:23.632280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-097abc0c-b102-4c07-9b52-2847e3b220c1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:23.633177 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-097abc0c-b102-4c07-9b52-2847e3b220c1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:23.639658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-097abc0c-b102-4c07-9b52-2847e3b220c1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:23.640103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-097abc0c-b102-4c07-9b52-2847e3b220c1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:23.640871 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-097abc0c-b102-4c07-9b52-2847e3b220c1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:23.641534 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-097abc0c-b102-4c07-9b52-2847e3b220c1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:23.744029 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-097abc0c-b102-4c07-9b52-2847e3b220c1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28487 microversion: 2.20 time: 0.115788 Jul 27 15:27:23.744736 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 432/888] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:23 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28487 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:24.484272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3697a2f5-df67-4efa-8d48-c5ce234d271c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:24.485264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3697a2f5-df67-4efa-8d48-c5ce234d271c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:24.491858 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3697a2f5-df67-4efa-8d48-c5ce234d271c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:24.492313 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3697a2f5-df67-4efa-8d48-c5ce234d271c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:24.493075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3697a2f5-df67-4efa-8d48-c5ce234d271c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:24.493511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3697a2f5-df67-4efa-8d48-c5ce234d271c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:24.603869 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3697a2f5-df67-4efa-8d48-c5ce234d271c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 18155 microversion: 2.1 time: 0.123469 Jul 27 15:27:24.604515 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 457/889] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:24 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 18155 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:24.756795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-343bfeb0-9d43-42ce-bde3-ca9e68ac20e8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:24.757703 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-343bfeb0-9d43-42ce-bde3-ca9e68ac20e8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:24.764155 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-343bfeb0-9d43-42ce-bde3-ca9e68ac20e8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:24.764624 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-343bfeb0-9d43-42ce-bde3-ca9e68ac20e8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:24.765372 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-343bfeb0-9d43-42ce-bde3-ca9e68ac20e8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:24.765811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-343bfeb0-9d43-42ce-bde3-ca9e68ac20e8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:24.875864 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-343bfeb0-9d43-42ce-bde3-ca9e68ac20e8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28655 microversion: 2.20 time: 0.123017 Jul 27 15:27:24.877344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 433/890] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:24 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:25.615025 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fae30a02-216c-4e4f-9515-850e26811118 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:25.616019 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fae30a02-216c-4e4f-9515-850e26811118 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:25.622397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fae30a02-216c-4e4f-9515-850e26811118 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:25.622883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fae30a02-216c-4e4f-9515-850e26811118 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:25.623650 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fae30a02-216c-4e4f-9515-850e26811118 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:25.624092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fae30a02-216c-4e4f-9515-850e26811118 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:25.731481 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fae30a02-216c-4e4f-9515-850e26811118 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 19133 microversion: 2.1 time: 0.120229 Jul 27 15:27:25.732132 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 458/891] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:25 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 19133 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:25.888102 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ba7ab67d-2f9e-4db6-bb25-043a1e5f6a35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:25.889013 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ba7ab67d-2f9e-4db6-bb25-043a1e5f6a35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:25.895512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba7ab67d-2f9e-4db6-bb25-043a1e5f6a35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:25.895960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba7ab67d-2f9e-4db6-bb25-043a1e5f6a35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:25.896728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba7ab67d-2f9e-4db6-bb25-043a1e5f6a35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:25.897160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ba7ab67d-2f9e-4db6-bb25-043a1e5f6a35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:25.996100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ba7ab67d-2f9e-4db6-bb25-043a1e5f6a35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28655 microversion: 2.20 time: 0.111971 Jul 27 15:27:25.996759 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 434/892] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:25 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:26.743361 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c29b2c06-50c5-48a6-a13b-f3a78a67b3a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:26.744272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c29b2c06-50c5-48a6-a13b-f3a78a67b3a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:26.750709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c29b2c06-50c5-48a6-a13b-f3a78a67b3a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:26.751158 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c29b2c06-50c5-48a6-a13b-f3a78a67b3a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:26.751924 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c29b2c06-50c5-48a6-a13b-f3a78a67b3a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:26.752358 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c29b2c06-50c5-48a6-a13b-f3a78a67b3a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:26.865703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c29b2c06-50c5-48a6-a13b-f3a78a67b3a6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 20991 microversion: 2.1 time: 0.126206 Jul 27 15:27:26.866358 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 459/893] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:26 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 20991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:27.008438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ea091ccb-fcd3-4b17-a55e-88ad1718c07c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:27.009342 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ea091ccb-fcd3-4b17-a55e-88ad1718c07c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:27.016467 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea091ccb-fcd3-4b17-a55e-88ad1718c07c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:27.016915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea091ccb-fcd3-4b17-a55e-88ad1718c07c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:27.017688 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea091ccb-fcd3-4b17-a55e-88ad1718c07c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:27.018112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ea091ccb-fcd3-4b17-a55e-88ad1718c07c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:27.118740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ea091ccb-fcd3-4b17-a55e-88ad1718c07c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28655 microversion: 2.20 time: 0.114187 Jul 27 15:27:27.119669 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 435/894] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:27 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:27.877802 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9c059a91-5210-43c3-8464-90e5f6769e8f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:27.878781 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9c059a91-5210-43c3-8464-90e5f6769e8f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:27.885200 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c059a91-5210-43c3-8464-90e5f6769e8f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:27.885650 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c059a91-5210-43c3-8464-90e5f6769e8f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:27.886415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c059a91-5210-43c3-8464-90e5f6769e8f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:27.886883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c059a91-5210-43c3-8464-90e5f6769e8f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:27.992674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9c059a91-5210-43c3-8464-90e5f6769e8f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 22660 microversion: 2.1 time: 0.118896 Jul 27 15:27:27.993351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 460/895] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:27 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 22660 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:28.130409 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a9b9175e-fa55-4c5f-bd12-f927405e7cd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:28.131420 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a9b9175e-fa55-4c5f-bd12-f927405e7cd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:28.137742 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a9b9175e-fa55-4c5f-bd12-f927405e7cd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:28.138181 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a9b9175e-fa55-4c5f-bd12-f927405e7cd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:28.138965 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a9b9175e-fa55-4c5f-bd12-f927405e7cd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:28.139395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a9b9175e-fa55-4c5f-bd12-f927405e7cd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:28.241028 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a9b9175e-fa55-4c5f-bd12-f927405e7cd3 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28655 microversion: 2.20 time: 0.114453 Jul 27 15:27:28.241584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 436/896] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:28 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:29.005566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ccaa890d-b256-4f4c-8c96-f8567e25e032 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:29.006523 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ccaa890d-b256-4f4c-8c96-f8567e25e032 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:29.013079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ccaa890d-b256-4f4c-8c96-f8567e25e032 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:29.013528 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ccaa890d-b256-4f4c-8c96-f8567e25e032 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:29.014292 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ccaa890d-b256-4f4c-8c96-f8567e25e032 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:29.014759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ccaa890d-b256-4f4c-8c96-f8567e25e032 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:29.117511 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ccaa890d-b256-4f4c-8c96-f8567e25e032 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 23229 microversion: 2.1 time: 0.116584 Jul 27 15:27:29.118167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 461/897] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:28 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 23229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:29.253134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-eacea7fb-7f5f-4129-abbb-84c4a33aeb18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:29.254123 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-eacea7fb-7f5f-4129-abbb-84c4a33aeb18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:29.260627 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eacea7fb-7f5f-4129-abbb-84c4a33aeb18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:29.261021 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eacea7fb-7f5f-4129-abbb-84c4a33aeb18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:29.261778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eacea7fb-7f5f-4129-abbb-84c4a33aeb18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:29.262213 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eacea7fb-7f5f-4129-abbb-84c4a33aeb18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:29.353148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-eacea7fb-7f5f-4129-abbb-84c4a33aeb18 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 28655 microversion: 2.20 time: 0.103889 Jul 27 15:27:29.353787 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 437/898] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:29 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 28655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:30.129352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e799e688-24a9-4830-8fcc-6b1048789146 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:30.130346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e799e688-24a9-4830-8fcc-6b1048789146 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:30.135035 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-102933022"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:30.135664 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:30.136808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e799e688-24a9-4830-8fcc-6b1048789146 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:30.137258 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e799e688-24a9-4830-8fcc-6b1048789146 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:30.138023 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e799e688-24a9-4830-8fcc-6b1048789146 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:30.138454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e799e688-24a9-4830-8fcc-6b1048789146 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:30.141718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:30.142185 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:30.142972 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:30.143405 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:30.231692 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e799e688-24a9-4830-8fcc-6b1048789146 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 24554 microversion: 2.1 time: 0.106737 Jul 27 15:27:30.235658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 462/899] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:30 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 24554 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:30.275641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.network.security_group_api [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Removing security group c3c8d4cc-9b9b-409b-98d0-909c9247b620 from port 0bb393d9-c24e-40b6-91a9-81412447d60f Jul 27 15:27:30.365889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d55f01df-2d38-4a98-9b9c-03ebe26ff41f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:30.366901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d55f01df-2d38-4a98-9b9c-03ebe26ff41f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:30.373205 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d55f01df-2d38-4a98-9b9c-03ebe26ff41f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:30.373657 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d55f01df-2d38-4a98-9b9c-03ebe26ff41f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:30.374420 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d55f01df-2d38-4a98-9b9c-03ebe26ff41f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:30.374883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d55f01df-2d38-4a98-9b9c-03ebe26ff41f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:30.480874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d55f01df-2d38-4a98-9b9c-03ebe26ff41f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 29445 microversion: 2.20 time: 0.119385 Jul 27 15:27:30.484677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 463/900] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:30 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 29445 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:30.623497 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e6fed246-33dd-4804-b380-ebc218bc072c tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/action" status: 202 len: 0 microversion: 2.1 time: 0.493121 Jul 27 15:27:30.627348 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 438/901] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:30 2021] POST /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:30.634759 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-13e52444-3c49-4250-8bd7-d44f6220a4aa req-eb093997-066f-49b2-a9e0-b1c38b7f6d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09456958-d9aa-49a0-b9ea-f982b7bee9d7", "tag": "0bb393d9-c24e-40b6-91a9-81412447d60f"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:30.636669 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:30.636669 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:27:30.650059 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-13e52444-3c49-4250-8bd7-d44f6220a4aa req-eb093997-066f-49b2-a9e0-b1c38b7f6d67 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:30.650643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-13e52444-3c49-4250-8bd7-d44f6220a4aa req-eb093997-066f-49b2-a9e0-b1c38b7f6d67 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:30.673440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-13e52444-3c49-4250-8bd7-d44f6220a4aa req-eb093997-066f-49b2-a9e0-b1c38b7f6d67 service nova] Creating event network-changed:0bb393d9-c24e-40b6-91a9-81412447d60f for instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 on hv-cinder-80043 Jul 27 15:27:30.679525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-13e52444-3c49-4250-8bd7-d44f6220a4aa req-eb093997-066f-49b2-a9e0-b1c38b7f6d67 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048870 Jul 27 15:27:30.680558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 464/902] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:31.243734 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-401994d7-9781-4511-8416-1ae3334fd026 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:31.244854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-401994d7-9781-4511-8416-1ae3334fd026 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:31.250975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-401994d7-9781-4511-8416-1ae3334fd026 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.251427 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-401994d7-9781-4511-8416-1ae3334fd026 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.252208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-401994d7-9781-4511-8416-1ae3334fd026 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.252728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-401994d7-9781-4511-8416-1ae3334fd026 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.350503 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-401994d7-9781-4511-8416-1ae3334fd026 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 25650 microversion: 2.1 time: 0.110597 Jul 27 15:27:31.351715 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 439/903] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:31 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 25650 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:31.492854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fe131aa9-750e-42f4-96a9-11aded5adc95 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:31.493837 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-fe131aa9-750e-42f4-96a9-11aded5adc95 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:31.499848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe131aa9-750e-42f4-96a9-11aded5adc95 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.500289 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe131aa9-750e-42f4-96a9-11aded5adc95 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.501051 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe131aa9-750e-42f4-96a9-11aded5adc95 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.501477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-fe131aa9-750e-42f4-96a9-11aded5adc95 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.601185 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fe131aa9-750e-42f4-96a9-11aded5adc95 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 30699 microversion: 2.20 time: 0.112192 Jul 27 15:27:31.605005 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 465/904] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:31 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 30699 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:31.784141 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:31.784725 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:31.791495 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.791942 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.792709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.793143 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.875610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lazy-loading 'services' on Instance uuid 09456958-d9aa-49a0-b9ea-f982b7bee9d7 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:27:31.944671 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d60e495c-232f-4b48-80ee-7fb0a269f062 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "DELETE /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments/b1d18036-89b0-4718-adeb-e12493a0bdf5" status: 202 len: 0 microversion: 2.1 time: 0.164423 Jul 27 15:27:31.945576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 440/905] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:27:31 2021] DELETE /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments/b1d18036-89b0-4718-adeb-e12493a0bdf5 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:31.954858 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f2929b7c-efcf-4853-a31c-26d99c93c03b tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:31.955862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f2929b7c-efcf-4853-a31c-26d99c93c03b tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:31.963506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2929b7c-efcf-4853-a31c-26d99c93c03b tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.963955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2929b7c-efcf-4853-a31c-26d99c93c03b tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.964806 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2929b7c-efcf-4853-a31c-26d99c93c03b tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:31.965299 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2929b7c-efcf-4853-a31c-26d99c93c03b tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:31.999134 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f2929b7c-efcf-4853-a31c-26d99c93c03b tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049022 Jul 27 15:27:31.999700 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 466/906] 10.222.0.37 () {58 vars in 1302 bytes} [Tue Jul 27 15:27:31 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:32.361716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-18d54006-ecbf-4c00-999e-3d71de7cce94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:32.363480 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-18d54006-ecbf-4c00-999e-3d71de7cce94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:32.369385 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18d54006-ecbf-4c00-999e-3d71de7cce94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:32.369833 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18d54006-ecbf-4c00-999e-3d71de7cce94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:32.370628 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18d54006-ecbf-4c00-999e-3d71de7cce94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:32.371070 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18d54006-ecbf-4c00-999e-3d71de7cce94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:32.483025 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-18d54006-ecbf-4c00-999e-3d71de7cce94 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 26585 microversion: 2.1 time: 0.125226 Jul 27 15:27:32.483677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 441/907] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:32 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 26585 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:32.612893 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6061c5c0-8ef7-47ac-b708-5d5a805b260d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:32.613722 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6061c5c0-8ef7-47ac-b708-5d5a805b260d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:32.620155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6061c5c0-8ef7-47ac-b708-5d5a805b260d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:32.620803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6061c5c0-8ef7-47ac-b708-5d5a805b260d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:32.621916 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6061c5c0-8ef7-47ac-b708-5d5a805b260d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:32.622573 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6061c5c0-8ef7-47ac-b708-5d5a805b260d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:32.696361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-49522326-dcee-4a37-b3a4-b655dc799555 req-7cee021c-3ec7-4041-9353-5fddd2b66744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09456958-d9aa-49a0-b9ea-f982b7bee9d7", "tag": "0bb393d9-c24e-40b6-91a9-81412447d60f"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:32.697870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:32.697870 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:27:32.705939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-49522326-dcee-4a37-b3a4-b655dc799555 req-7cee021c-3ec7-4041-9353-5fddd2b66744 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:32.706922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-49522326-dcee-4a37-b3a4-b655dc799555 req-7cee021c-3ec7-4041-9353-5fddd2b66744 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:32.718421 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-49522326-dcee-4a37-b3a4-b655dc799555 req-7cee021c-3ec7-4041-9353-5fddd2b66744 service nova] Creating event network-changed:0bb393d9-c24e-40b6-91a9-81412447d60f for instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 on hv-cinder-80043 Jul 27 15:27:32.723881 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-49522326-dcee-4a37-b3a4-b655dc799555 req-7cee021c-3ec7-4041-9353-5fddd2b66744 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032176 Jul 27 15:27:32.724060 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6061c5c0-8ef7-47ac-b708-5d5a805b260d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 32061 microversion: 2.20 time: 0.114697 Jul 27 15:27:32.724850 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 442/908] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:32.725874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 467/909] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:32 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 32061 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:33.012319 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c06cd3e3-77be-4d9d-97cd-6e7fc93537ae tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:33.013391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c06cd3e3-77be-4d9d-97cd-6e7fc93537ae tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:33.019948 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c06cd3e3-77be-4d9d-97cd-6e7fc93537ae tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.020508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c06cd3e3-77be-4d9d-97cd-6e7fc93537ae tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.021394 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c06cd3e3-77be-4d9d-97cd-6e7fc93537ae tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.021791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c06cd3e3-77be-4d9d-97cd-6e7fc93537ae tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.050643 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c06cd3e3-77be-4d9d-97cd-6e7fc93537ae tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042623 Jul 27 15:27:33.051205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 443/910] 10.222.0.37 () {58 vars in 1302 bytes} [Tue Jul 27 15:27:33 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 15:27:33.061346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:33.061959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:33.069287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.069739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.070593 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.071038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.148996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] HTTP exception thrown: Instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 is not attached to volume b1d18036-89b0-4718-adeb-e12493a0bdf5 Jul 27 15:27:33.149590 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Returning 404 to user: Instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 is not attached to volume b1d18036-89b0-4718-adeb-e12493a0bdf5 {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:27:33.150420 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ef73a9d2-03ee-4bbe-80c0-62d33a5196f2 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "DELETE /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments/b1d18036-89b0-4718-adeb-e12493a0bdf5" status: 404 len: 154 microversion: 2.1 time: 0.093272 Jul 27 15:27:33.151032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 468/911] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:27:33 2021] DELETE /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7/os-volume_attachments/b1d18036-89b0-4718-adeb-e12493a0bdf5 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:27:33.494957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e538111f-b58c-41ae-9517-c96c3c53889f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:33.495778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e538111f-b58c-41ae-9517-c96c3c53889f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:33.501395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e538111f-b58c-41ae-9517-c96c3c53889f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.501836 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e538111f-b58c-41ae-9517-c96c3c53889f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.502614 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e538111f-b58c-41ae-9517-c96c3c53889f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.503046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e538111f-b58c-41ae-9517-c96c3c53889f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.606622 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e538111f-b58c-41ae-9517-c96c3c53889f tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 27364 microversion: 2.1 time: 0.115465 Jul 27 15:27:33.607246 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 444/912] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:33 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 27364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:33.735772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3e06a268-2d18-48fb-b83c-0483b2e87bfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:33.736723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3e06a268-2d18-48fb-b83c-0483b2e87bfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:33.743233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3e06a268-2d18-48fb-b83c-0483b2e87bfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.743675 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3e06a268-2d18-48fb-b83c-0483b2e87bfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.744427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3e06a268-2d18-48fb-b83c-0483b2e87bfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:33.744857 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3e06a268-2d18-48fb-b83c-0483b2e87bfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:33.844090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3e06a268-2d18-48fb-b83c-0483b2e87bfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 33034 microversion: 2.20 time: 0.111822 Jul 27 15:27:33.844620 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 469/913] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:33 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 33034 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:34.286291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:34.286920 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:34.293499 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.293940 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.294722 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.295149 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.318503 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:27:34.388086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-46adce0c-e014-4b8d-8899-3af7a9128dd7 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "DELETE /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 204 len: 0 microversion: 2.1 time: 0.106076 Jul 27 15:27:34.388676 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 445/914] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:27:34 2021] DELETE /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:27:34.399352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:34.400048 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:34.407417 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.407862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.408627 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.409057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.549602 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:34.556714 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2b9acf5d-cc72-4e3a-9b92-880089b6cc49 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1553 microversion: 2.1 time: 0.161911 Jul 27 15:27:34.557276 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 470/915] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:34 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:34.617447 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a6b3ab4a-397e-4426-96ee-cee35f20c26c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:34.618488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a6b3ab4a-397e-4426-96ee-cee35f20c26c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:34.624187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a6b3ab4a-397e-4426-96ee-cee35f20c26c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.624638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a6b3ab4a-397e-4426-96ee-cee35f20c26c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.625403 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a6b3ab4a-397e-4426-96ee-cee35f20c26c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.625842 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a6b3ab4a-397e-4426-96ee-cee35f20c26c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.727569 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a6b3ab4a-397e-4426-96ee-cee35f20c26c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 27907 microversion: 2.1 time: 0.114002 Jul 27 15:27:34.728173 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 446/916] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:34 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 27907 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:34.855925 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-29acebc3-67b5-40de-959f-6c20032b0a71 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:34.856809 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-29acebc3-67b5-40de-959f-6c20032b0a71 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:34.862603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-29acebc3-67b5-40de-959f-6c20032b0a71 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.863045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-29acebc3-67b5-40de-959f-6c20032b0a71 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.864285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-29acebc3-67b5-40de-959f-6c20032b0a71 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:34.864710 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-29acebc3-67b5-40de-959f-6c20032b0a71 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:34.960950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-29acebc3-67b5-40de-959f-6c20032b0a71 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 33759 microversion: 2.20 time: 0.108617 Jul 27 15:27:34.961634 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 471/917] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:34 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 33759 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:27:35.169260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-839765111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2028062658", "security_groups": [{"name": "tempest-secgroup-smoke-948308224"}], "block_device_mapping_v2": [{"uuid": "287afd19-7655-4a44-b35c-425e266b7f6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "16425a87-2cd0-48ad-8f02-b03806548cee"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:35.269242 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] validate_networks() for [('16425a87-2cd0-48ad-8f02-b03806548cee', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:27:35.573425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:35.574232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:35.580662 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.581105 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:35.581869 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.582822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:35.665174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:27:35.665654 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:27:35.666060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:27:35.666488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:27:35.666912 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:27:35.675432 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.675883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:35.677276 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.677751 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:35.693810 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for project e9a65d475c9846dfabea23794dd2e636. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:27:35.697746 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for user 56acc4e200664d4b850d1f84a946e576 and project e9a65d475c9846dfabea23794dd2e636. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:27:35.733934 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:35.741080 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e2b321fb-cd71-47ec-bb7f-53c28b74366d tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1553 microversion: 2.1 time: 0.171634 Jul 27 15:27:35.741642 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 472/918] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:35 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:27:35.745893 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-807d7957-b741-4709-9061-07f21d6383d8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:35.746798 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-807d7957-b741-4709-9061-07f21d6383d8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:35.752690 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-807d7957-b741-4709-9061-07f21d6383d8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.753139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-807d7957-b741-4709-9061-07f21d6383d8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:35.753935 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-807d7957-b741-4709-9061-07f21d6383d8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.754398 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-807d7957-b741-4709-9061-07f21d6383d8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:35.758492 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:27:35.760788 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='287afd19-7655-4a44-b35c-425e266b7f6a',volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:27:35.855949 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-807d7957-b741-4709-9061-07f21d6383d8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28215 microversion: 2.1 time: 0.113117 Jul 27 15:27:35.856588 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 473/919] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:35 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:35.881911 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-142cc532-e249-47be-a6c3-493bdaa6fdf0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716578 Jul 27 15:27:35.882567 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 447/920] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:27:35 2021] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 15:27:35.892413 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b620d186-bcab-4dec-b20d-242471aa3ea7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:35.893108 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b620d186-bcab-4dec-b20d-242471aa3ea7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:35.952788 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b620d186-bcab-4dec-b20d-242471aa3ea7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:35.959830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b620d186-bcab-4dec-b20d-242471aa3ea7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1094 microversion: 2.1 time: 0.071374 Jul 27 15:27:35.960402 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 474/921] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:35 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:35.972873 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8ad9bb68-98c4-4bdb-afb7-6f06776eaa7e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:35.973923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8ad9bb68-98c4-4bdb-afb7-6f06776eaa7e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:35.980066 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ad9bb68-98c4-4bdb-afb7-6f06776eaa7e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.980580 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ad9bb68-98c4-4bdb-afb7-6f06776eaa7e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:35.981532 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ad9bb68-98c4-4bdb-afb7-6f06776eaa7e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:35.981955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8ad9bb68-98c4-4bdb-afb7-6f06776eaa7e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:36.083901 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8ad9bb68-98c4-4bdb-afb7-6f06776eaa7e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 34540 microversion: 2.20 time: 0.114829 Jul 27 15:27:36.084584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 448/922] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:35 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 34540 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:36.757406 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:36.758013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:36.764819 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:36.765263 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:36.766026 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:36.766453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:36.874370 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-921635c3-f5d3-4bbd-85f4-55c256133457 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:36.880171 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-921635c3-f5d3-4bbd-85f4-55c256133457 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:36.887486 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-921635c3-f5d3-4bbd-85f4-55c256133457 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:36.888010 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-921635c3-f5d3-4bbd-85f4-55c256133457 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:36.888788 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-921635c3-f5d3-4bbd-85f4-55c256133457 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:36.889222 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-921635c3-f5d3-4bbd-85f4-55c256133457 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:36.925170 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1fedd1d1cd4e15b16026f89f792380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c187b19f4a4b289f866e96946b7e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:36.933308 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e31ba470-06cb-4be5-8567-f181ec1e100a tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 200 len: 1553 microversion: 2.1 time: 0.180017 Jul 27 15:27:36.934247 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 475/923] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:36 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:36.977376 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:36.978000 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:36.983637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:36.984080 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:36.985543 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:36.985976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:36.989308 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-921635c3-f5d3-4bbd-85f4-55c256133457 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28217 microversion: 2.1 time: 0.123423 Jul 27 15:27:36.990881 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 449/924] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:36 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:37.059183 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:37.075620 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e4f9cde8-43ff-44d3-9cd0-ad8c3cc4c139 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1200 microversion: 2.1 time: 0.102855 Jul 27 15:27:37.079568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 476/925] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:36 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:27:37.096264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5e35535e-6773-4a23-a385-383ec5ca3c3e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:37.097469 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5e35535e-6773-4a23-a385-383ec5ca3c3e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:37.104265 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5e35535e-6773-4a23-a385-383ec5ca3c3e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:37.104865 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5e35535e-6773-4a23-a385-383ec5ca3c3e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:37.105783 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5e35535e-6773-4a23-a385-383ec5ca3c3e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:37.106314 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5e35535e-6773-4a23-a385-383ec5ca3c3e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:37.235384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-80660f8e-6856-4d3d-b6c3-3abe0f6d9779 req-56186268-f0e2-42e3-abed-1dd7580cef10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09456958-d9aa-49a0-b9ea-f982b7bee9d7", "name": "network-vif-deleted", "tag": "0bb393d9-c24e-40b6-91a9-81412447d60f"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:37.236946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:37.236946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:27:37.242943 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5e35535e-6773-4a23-a385-383ec5ca3c3e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 35346 microversion: 2.20 time: 0.150613 Jul 27 15:27:37.247144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 450/926] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:37 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 35346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:37.250338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-80660f8e-6856-4d3d-b6c3-3abe0f6d9779 req-56186268-f0e2-42e3-abed-1dd7580cef10 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:37.250868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-80660f8e-6856-4d3d-b6c3-3abe0f6d9779 req-56186268-f0e2-42e3-abed-1dd7580cef10 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:37.262428 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-80660f8e-6856-4d3d-b6c3-3abe0f6d9779 req-56186268-f0e2-42e3-abed-1dd7580cef10 service nova] Creating event network-vif-deleted:0bb393d9-c24e-40b6-91a9-81412447d60f for instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 on hv-cinder-80043 Jul 27 15:27:37.267147 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-80660f8e-6856-4d3d-b6c3-3abe0f6d9779 req-56186268-f0e2-42e3-abed-1dd7580cef10 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035461 Jul 27 15:27:37.267737 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 477/927] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:37.952112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:37.956798 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] [instance: 09456958-d9aa-49a0-b9ea-f982b7bee9d7] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:37.967043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:37.967998 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:37.968622 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:37.969052 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:37.986071 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] HTTP exception thrown: Instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 could not be found. Jul 27 15:27:37.987064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Returning 404 to user: Instance 09456958-d9aa-49a0-b9ea-f982b7bee9d7 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:27:37.989580 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9d37547c-0b8b-4f22-ad6a-46c36b938d20 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7" status: 404 len: 111 microversion: 2.1 time: 0.040154 Jul 27 15:27:37.990672 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 451/928] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:37 2021] GET /compute/v2.1/servers/09456958-d9aa-49a0-b9ea-f982b7bee9d7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:27:37.999399 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7626d5d7-e529-497e-907f-7285da76b5c4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] Calling method '.version_select at 0x7f33f770a430>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:38.000004 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f80b2deb-f3a7-47d7-a420-b646aeb76c55 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:38.000903 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f80b2deb-f3a7-47d7-a420-b646aeb76c55 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:38.007629 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f80b2deb-f3a7-47d7-a420-b646aeb76c55 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:38.008088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f80b2deb-f3a7-47d7-a420-b646aeb76c55 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:38.008867 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f80b2deb-f3a7-47d7-a420-b646aeb76c55 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:38.009303 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f80b2deb-f3a7-47d7-a420-b646aeb76c55 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:38.017350 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7626d5d7-e529-497e-907f-7285da76b5c4 tempest-TestMinimumBasicScenario-916396916 tempest-TestMinimumBasicScenario-916396916-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-863810951" status: 202 len: 0 microversion: 2.1 time: 0.022020 Jul 27 15:27:38.018149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 478/929] 10.222.0.37 () {58 vars in 1269 bytes} [Tue Jul 27 15:27:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-863810951 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:38.096735 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:38.097835 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:38.104087 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:38.104845 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:38.105846 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:38.106534 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:38.108644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f80b2deb-f3a7-47d7-a420-b646aeb76c55 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28217 microversion: 2.1 time: 0.111476 Jul 27 15:27:38.116723 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 452/930] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:37 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:27:38.255932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9aa0f3dc-fc5f-4036-892c-35a6c5ad647d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:38.257662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9aa0f3dc-fc5f-4036-892c-35a6c5ad647d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:38.265280 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa0f3dc-fc5f-4036-892c-35a6c5ad647d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:38.265735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa0f3dc-fc5f-4036-892c-35a6c5ad647d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:38.266551 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa0f3dc-fc5f-4036-892c-35a6c5ad647d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:38.266994 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9aa0f3dc-fc5f-4036-892c-35a6c5ad647d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:38.334801 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:38.342689 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-84131852-007d-41fa-bad5-b5e1063a419e tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.249411 Jul 27 15:27:38.343334 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 479/931] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:38 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:27:38.376316 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9aa0f3dc-fc5f-4036-892c-35a6c5ad647d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 36437 microversion: 2.20 time: 0.124808 Jul 27 15:27:38.377300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 453/932] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:38 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 36437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:38.657347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-202c471b-a5cd-424a-946e-2d38036b1727 req-8fa838a4-10e4-472d-8e39-328eed0ffd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ef0c4e-a573-460d-aa95-239b4e897f74", "tag": "9ab698a3-e6c8-41e5-9918-2837ecadc50b"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:38.659055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:38.659055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:27:38.675484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-202c471b-a5cd-424a-946e-2d38036b1727 req-8fa838a4-10e4-472d-8e39-328eed0ffd32 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:38.676466 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-202c471b-a5cd-424a-946e-2d38036b1727 req-8fa838a4-10e4-472d-8e39-328eed0ffd32 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:38.688931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-202c471b-a5cd-424a-946e-2d38036b1727 req-8fa838a4-10e4-472d-8e39-328eed0ffd32 service nova] Creating event network-changed:9ab698a3-e6c8-41e5-9918-2837ecadc50b for instance 87ef0c4e-a573-460d-aa95-239b4e897f74 on hv-cinder-80043 Jul 27 15:27:38.703688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-202c471b-a5cd-424a-946e-2d38036b1727 req-8fa838a4-10e4-472d-8e39-328eed0ffd32 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050750 Jul 27 15:27:38.703688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 480/933] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:39.121633 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b5976597-999d-4900-9bc3-36b548940ae4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:39.122975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b5976597-999d-4900-9bc3-36b548940ae4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:39.130257 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5976597-999d-4900-9bc3-36b548940ae4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:39.130727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5976597-999d-4900-9bc3-36b548940ae4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:39.131507 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5976597-999d-4900-9bc3-36b548940ae4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:39.131935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b5976597-999d-4900-9bc3-36b548940ae4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:39.288500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b5976597-999d-4900-9bc3-36b548940ae4 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28508 microversion: 2.1 time: 0.170880 Jul 27 15:27:39.289573 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 454/934] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:39 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:39.360383 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:39.361209 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:39.368500 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:39.369058 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:39.369895 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:39.370414 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:39.390484 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d3e850bc-3803-427b-989b-5366ad280429 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:39.391732 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d3e850bc-3803-427b-989b-5366ad280429 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:39.399041 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e850bc-3803-427b-989b-5366ad280429 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:39.399706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e850bc-3803-427b-989b-5366ad280429 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:39.401171 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e850bc-3803-427b-989b-5366ad280429 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:39.401771 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d3e850bc-3803-427b-989b-5366ad280429 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:39.509752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d3e850bc-3803-427b-989b-5366ad280429 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 37643 microversion: 2.20 time: 0.123662 Jul 27 15:27:39.510701 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 455/935] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:39 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 37643 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:39.607597 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:39.616671 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-286c0e5d-3863-484b-a789-00e60eb05825 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.260277 Jul 27 15:27:39.617355 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 481/936] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:39 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:40.301558 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9e4c6484-ae29-423f-969d-99a4aa41d292 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:40.302580 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9e4c6484-ae29-423f-969d-99a4aa41d292 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:40.308978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e4c6484-ae29-423f-969d-99a4aa41d292 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:40.309419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e4c6484-ae29-423f-969d-99a4aa41d292 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:40.310178 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e4c6484-ae29-423f-969d-99a4aa41d292 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:40.310635 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9e4c6484-ae29-423f-969d-99a4aa41d292 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:40.415631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9e4c6484-ae29-423f-969d-99a4aa41d292 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28676 microversion: 2.1 time: 0.117878 Jul 27 15:27:40.416389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 456/937] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:40 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28676 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:40.522494 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cf0ec8c1-e306-4d64-9714-5cc72e432947 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:40.524046 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cf0ec8c1-e306-4d64-9714-5cc72e432947 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:40.530332 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf0ec8c1-e306-4d64-9714-5cc72e432947 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:40.530820 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf0ec8c1-e306-4d64-9714-5cc72e432947 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:40.531605 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf0ec8c1-e306-4d64-9714-5cc72e432947 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:40.532041 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cf0ec8c1-e306-4d64-9714-5cc72e432947 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:40.624124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cf0ec8c1-e306-4d64-9714-5cc72e432947 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 38201 microversion: 2.20 time: 0.106090 Jul 27 15:27:40.624855 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 482/938] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:40 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 38201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:40.635379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:40.636335 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:40.643343 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:40.643932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:40.645354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:40.645951 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:40.791737 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:40.799760 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f04137c2-4e2d-4300-b5b4-d2f27281a7be tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.169220 Jul 27 15:27:40.806708 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 457/939] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:40 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:41.427579 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2dbb4ffc-7594-4bcd-8099-504d31357713 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:41.428637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2dbb4ffc-7594-4bcd-8099-504d31357713 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:41.435309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2dbb4ffc-7594-4bcd-8099-504d31357713 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:41.435817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2dbb4ffc-7594-4bcd-8099-504d31357713 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:41.436594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2dbb4ffc-7594-4bcd-8099-504d31357713 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:41.437032 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2dbb4ffc-7594-4bcd-8099-504d31357713 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:41.530457 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2dbb4ffc-7594-4bcd-8099-504d31357713 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28676 microversion: 2.1 time: 0.107296 Jul 27 15:27:41.531531 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 483/940] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:41 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28676 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:41.636323 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2ae21ccd-6fa5-4734-9d5d-8ea37e653faa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:41.637237 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2ae21ccd-6fa5-4734-9d5d-8ea37e653faa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:41.643532 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2ae21ccd-6fa5-4734-9d5d-8ea37e653faa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:41.643984 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2ae21ccd-6fa5-4734-9d5d-8ea37e653faa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:41.645247 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2ae21ccd-6fa5-4734-9d5d-8ea37e653faa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:41.645684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2ae21ccd-6fa5-4734-9d5d-8ea37e653faa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:41.734175 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2ae21ccd-6fa5-4734-9d5d-8ea37e653faa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 38201 microversion: 2.20 time: 0.101285 Jul 27 15:27:41.735825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 458/941] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:41 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 38201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:41.817978 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:41.818738 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:41.825494 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:41.825944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:41.826779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:41.827223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:42.059660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:42.067966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9c791d55-c4ce-46f5-b47b-76c8fdc8af52 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.254711 Jul 27 15:27:42.068844 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 484/942] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:41 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:42.543421 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9ccdc063-1ec9-43f3-a583-45a3fed73649 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:42.544428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9ccdc063-1ec9-43f3-a583-45a3fed73649 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:42.551672 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ccdc063-1ec9-43f3-a583-45a3fed73649 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:42.552144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ccdc063-1ec9-43f3-a583-45a3fed73649 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:42.552959 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ccdc063-1ec9-43f3-a583-45a3fed73649 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:42.553395 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9ccdc063-1ec9-43f3-a583-45a3fed73649 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:42.645939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9ccdc063-1ec9-43f3-a583-45a3fed73649 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28676 microversion: 2.1 time: 0.106546 Jul 27 15:27:42.646611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 459/943] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:42 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28676 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:42.745458 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-aa9f4403-15f3-4ef4-8a3c-3b0948cdc235 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:42.746521 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-aa9f4403-15f3-4ef4-8a3c-3b0948cdc235 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:42.752717 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa9f4403-15f3-4ef4-8a3c-3b0948cdc235 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:42.753160 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa9f4403-15f3-4ef4-8a3c-3b0948cdc235 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:42.753933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa9f4403-15f3-4ef4-8a3c-3b0948cdc235 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:42.754366 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-aa9f4403-15f3-4ef4-8a3c-3b0948cdc235 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:42.839570 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-aa9f4403-15f3-4ef4-8a3c-3b0948cdc235 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 38201 microversion: 2.20 time: 0.097636 Jul 27 15:27:42.843668 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 485/944] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:42 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 38201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:43.085689 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:43.086383 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:43.094088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.094570 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:43.095555 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.095991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:43.240620 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:43.248514 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-989255da-b295-4781-a29f-4f633eb0dc8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.167736 Jul 27 15:27:43.249086 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 460/945] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:43 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:43.658121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ad1b5510-5dfb-42db-9414-61ce4f79fdef tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:43.659297 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ad1b5510-5dfb-42db-9414-61ce4f79fdef tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:43.666428 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad1b5510-5dfb-42db-9414-61ce4f79fdef tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.666769 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad1b5510-5dfb-42db-9414-61ce4f79fdef tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:43.667564 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad1b5510-5dfb-42db-9414-61ce4f79fdef tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.667996 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ad1b5510-5dfb-42db-9414-61ce4f79fdef tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:43.759839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ad1b5510-5dfb-42db-9414-61ce4f79fdef tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28676 microversion: 2.1 time: 0.105394 Jul 27 15:27:43.760481 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 486/946] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:43 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28676 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:43.851599 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1af92921-65c4-4c09-8379-c0fc5c98fe93 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:43.853191 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1af92921-65c4-4c09-8379-c0fc5c98fe93 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:43.859372 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1af92921-65c4-4c09-8379-c0fc5c98fe93 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.859897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1af92921-65c4-4c09-8379-c0fc5c98fe93 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:43.860675 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1af92921-65c4-4c09-8379-c0fc5c98fe93 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.861237 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1af92921-65c4-4c09-8379-c0fc5c98fe93 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:43.956912 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1af92921-65c4-4c09-8379-c0fc5c98fe93 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 200 len: 38342 microversion: 2.20 time: 0.108949 Jul 27 15:27:43.958429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 461/947] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:43 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 38342 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:27:43.967975 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2409d8fd-4f50-4302-be7d-f8490235243b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:43.968554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2409d8fd-4f50-4302-be7d-f8490235243b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:43.975658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2409d8fd-4f50-4302-be7d-f8490235243b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.975847 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2409d8fd-4f50-4302-be7d-f8490235243b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:43.976572 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2409d8fd-4f50-4302-be7d-f8490235243b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:43.976964 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2409d8fd-4f50-4302-be7d-f8490235243b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:44.003083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2409d8fd-4f50-4302-be7d-f8490235243b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/ips" status: 200 len: 152 microversion: 2.20 time: 0.038969 Jul 27 15:27:44.004834 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 487/948] 10.222.0.37 () {60 vars in 1289 bytes} [Tue Jul 27 15:27:43 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:44.266393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:44.268005 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:44.282229 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:44.282656 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:44.283465 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:44.283913 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:44.455652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:44.463769 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-df674b5c-65f5-4489-b2f2-face66b7f596 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.202073 Jul 27 15:27:44.464337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 462/949] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:44 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:44.771255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-70913019-23c2-441b-aeb7-d80ce3e9c183 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:44.773222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-70913019-23c2-441b-aeb7-d80ce3e9c183 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:44.780038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70913019-23c2-441b-aeb7-d80ce3e9c183 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:44.780698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70913019-23c2-441b-aeb7-d80ce3e9c183 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:44.782074 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70913019-23c2-441b-aeb7-d80ce3e9c183 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:44.782785 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-70913019-23c2-441b-aeb7-d80ce3e9c183 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:44.906241 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-70913019-23c2-441b-aeb7-d80ce3e9c183 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 28676 microversion: 2.1 time: 0.139226 Jul 27 15:27:44.906922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 488/950] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:44 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 28676 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:45.482743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:45.483353 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:45.490020 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:45.490488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:45.491707 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:45.492140 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:45.636347 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:45.644576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bb167689-4b00-4202-b77e-d02a4d6401aa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.167030 Jul 27 15:27:45.645326 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 463/951] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:45 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:45.918360 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a85096e8-64d7-40ad-b861-c545494f6ba1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:45.919380 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a85096e8-64d7-40ad-b861-c545494f6ba1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:45.926960 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a85096e8-64d7-40ad-b861-c545494f6ba1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:45.927081 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a85096e8-64d7-40ad-b861-c545494f6ba1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:45.927843 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a85096e8-64d7-40ad-b861-c545494f6ba1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:45.928455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a85096e8-64d7-40ad-b861-c545494f6ba1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:46.042285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a85096e8-64d7-40ad-b861-c545494f6ba1 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 29896 microversion: 2.1 time: 0.128057 Jul 27 15:27:46.045822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 489/952] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:45 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 29896 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:46.106120 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:46.106706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:46.112561 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:46.113001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:46.113940 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:46.114543 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:46.138905 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lazy-loading 'flavor' on Instance uuid 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:27:46.413938 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-986cd03a-80d3-48b2-8297-e6d4e1f39ffe tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 202 len: 0 microversion: 2.20 time: 0.311490 Jul 27 15:27:46.414939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 464/953] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:27:46 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:27:46.423400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:46.424423 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:46.431973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:46.432442 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:46.433345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:46.433808 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:46.581140 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:46.589375 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:46.590976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:46.592181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3debda00-0c07-4c63-b2c5-d6ea42d6ae47 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.172869 Jul 27 15:27:46.592811 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 490/954] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:46 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:27:46.661434 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:46.662137 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:46.668590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:46.669047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:46.669811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:46.670246 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:46.807611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:46.815498 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a8a5967c-3b81-4724-9a69-24ed6e867462 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.158112 Jul 27 15:27:46.817142 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 465/955] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:46 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:47.054507 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-df2d2138-7c6d-4c51-af88-f81bc3cd94c8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:47.055443 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-df2d2138-7c6d-4c51-af88-f81bc3cd94c8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:47.061475 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df2d2138-7c6d-4c51-af88-f81bc3cd94c8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:47.061921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df2d2138-7c6d-4c51-af88-f81bc3cd94c8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:47.062731 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df2d2138-7c6d-4c51-af88-f81bc3cd94c8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:47.063198 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df2d2138-7c6d-4c51-af88-f81bc3cd94c8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:47.168880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-df2d2138-7c6d-4c51-af88-f81bc3cd94c8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 31725 microversion: 2.1 time: 0.118570 Jul 27 15:27:47.169502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 491/956] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:47 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 31725 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:47.609321 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:47.609855 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:47.616062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:47.616504 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:47.617251 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:47.617677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:47.748322 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:47.756288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:47.757778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:47.758961 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8080043e-64d1-4f4e-9a78-2f7bde859fa1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.153378 Jul 27 15:27:47.759522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 466/957] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:47 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:47.833765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:47.834459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:47.840958 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:47.841399 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:47.842165 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:47.842632 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:47.982410 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:47.996048 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d0ed6e77-67cb-41a7-a0cb-fb4fc2522f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.166715 Jul 27 15:27:47.996830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 492/958] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:47 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:48.168138 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-929ce7ae-ec3a-4015-898d-679469abe61c req-f8bf6b75-9418-4dce-9049-b4108c7e5fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ef0c4e-a573-460d-aa95-239b4e897f74", "name": "network-vif-plugged", "status": "completed", "tag": "9ab698a3-e6c8-41e5-9918-2837ecadc50b"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:48.169784 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:48.169784 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:27:48.177417 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-929ce7ae-ec3a-4015-898d-679469abe61c req-f8bf6b75-9418-4dce-9049-b4108c7e5fd7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:48.177857 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-929ce7ae-ec3a-4015-898d-679469abe61c req-f8bf6b75-9418-4dce-9049-b4108c7e5fd7 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:48.180594 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bfd178d9-54a2-4fcc-bafc-07c35714027e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:48.181493 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bfd178d9-54a2-4fcc-bafc-07c35714027e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:48.187111 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bfd178d9-54a2-4fcc-bafc-07c35714027e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:48.187557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bfd178d9-54a2-4fcc-bafc-07c35714027e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:48.188314 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bfd178d9-54a2-4fcc-bafc-07c35714027e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:48.188506 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-929ce7ae-ec3a-4015-898d-679469abe61c req-f8bf6b75-9418-4dce-9049-b4108c7e5fd7 service nova] Creating event network-vif-plugged:9ab698a3-e6c8-41e5-9918-2837ecadc50b for instance 87ef0c4e-a573-460d-aa95-239b4e897f74 on hv-cinder-80043 Jul 27 15:27:48.188743 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bfd178d9-54a2-4fcc-bafc-07c35714027e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:48.193981 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-929ce7ae-ec3a-4015-898d-679469abe61c req-f8bf6b75-9418-4dce-9049-b4108c7e5fd7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197852 Jul 27 15:27:48.194945 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 467/959] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:48.291195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bfd178d9-54a2-4fcc-bafc-07c35714027e tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 32986 microversion: 2.1 time: 0.113891 Jul 27 15:27:48.291831 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 493/960] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:48 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 32986 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:27:48.777788 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:48.778554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:48.784437 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:48.785731 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:48.786673 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:48.787106 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:48.920618 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:48.929028 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:48.930522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:48.931651 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-11aad292-d69a-43d1-9cbf-ce2358dad6aa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.157938 Jul 27 15:27:48.932196 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 468/961] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:48 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:49.013043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:49.013747 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:49.020856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:49.021326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:49.022094 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:49.022557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:49.158170 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:49.166188 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9b489d00-baf5-46e5-a3f1-bc9ad5a2f3df tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1265 microversion: 2.1 time: 0.157204 Jul 27 15:27:49.166770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 494/962] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:49 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:49.304720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-964806e7-5513-4865-8886-414bfaae84b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:49.305621 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-964806e7-5513-4865-8886-414bfaae84b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:49.311397 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-964806e7-5513-4865-8886-414bfaae84b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:49.311838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-964806e7-5513-4865-8886-414bfaae84b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:49.312596 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-964806e7-5513-4865-8886-414bfaae84b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:49.313024 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-964806e7-5513-4865-8886-414bfaae84b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:49.427223 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-964806e7-5513-4865-8886-414bfaae84b0 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 33736 microversion: 2.1 time: 0.127486 Jul 27 15:27:49.427883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 469/963] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:49 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 33736 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:49.948853 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:49.949450 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:49.955260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:49.955697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:49.956443 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:49.956926 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:50.088357 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:50.095905 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:50.097873 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:50.099029 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2af853f3-3366-4103-a8bb-626774694dd4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.153887 Jul 27 15:27:50.099583 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 495/964] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:49 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:50.182962 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:50.183598 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:50.189977 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:50.190425 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:50.191227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:50.191663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:50.324714 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:50.331918 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-dcdfbc62-f9b3-4a90-991c-7d34ac73b8c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1452 microversion: 2.1 time: 0.153035 Jul 27 15:27:50.332480 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 470/965] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:50 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:50.348187 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:50.348803 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:50.354432 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:50.354906 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:50.355663 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:50.356092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:50.438848 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3a228573-be0d-4c02-ad3f-8aa15fce1c88 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:50.439679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3a228573-be0d-4c02-ad3f-8aa15fce1c88 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:50.445342 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a228573-be0d-4c02-ad3f-8aa15fce1c88 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:50.445796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a228573-be0d-4c02-ad3f-8aa15fce1c88 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:50.446588 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a228573-be0d-4c02-ad3f-8aa15fce1c88 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:50.447039 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3a228573-be0d-4c02-ad3f-8aa15fce1c88 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:50.491891 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:50.499082 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6033bc44-8fd9-48a0-8f9c-44391d745921 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1452 microversion: 2.1 time: 0.154974 Jul 27 15:27:50.499637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 496/966] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:27:50 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:27:50.537554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3a228573-be0d-4c02-ad3f-8aa15fce1c88 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 34595 microversion: 2.1 time: 0.102311 Jul 27 15:27:50.538272 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 471/967] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:50 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 34595 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:27:51.118073 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:51.118709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:51.124509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:51.124955 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:51.125716 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:51.126145 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:51.377456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:51.385584 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:51.387410 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:51.388536 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-cacf3018-ef19-4427-89ae-ea633425204a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.275584 Jul 27 15:27:51.389080 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 497/968] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:51 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:51.549568 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f8a0401a-b5e7-4e93-8877-7524cfc3ee38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:51.551711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f8a0401a-b5e7-4e93-8877-7524cfc3ee38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:51.558149 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8a0401a-b5e7-4e93-8877-7524cfc3ee38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:51.558632 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8a0401a-b5e7-4e93-8877-7524cfc3ee38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:51.559419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8a0401a-b5e7-4e93-8877-7524cfc3ee38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:51.559858 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8a0401a-b5e7-4e93-8877-7524cfc3ee38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:51.664301 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f8a0401a-b5e7-4e93-8877-7524cfc3ee38 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 35855 microversion: 2.1 time: 0.118290 Jul 27 15:27:51.668453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 472/969] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:51 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 35855 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:52.296979 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-2574011a-2621-4d95-a286-bdfcc0a9d853 req-7077e97f-324e-471a-8931-3703597667d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ef0c4e-a573-460d-aa95-239b4e897f74", "tag": "9ab698a3-e6c8-41e5-9918-2837ecadc50b"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:52.298459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:27:52.298459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:27:52.305677 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-2574011a-2621-4d95-a286-bdfcc0a9d853 req-7077e97f-324e-471a-8931-3703597667d6 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:52.306122 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-2574011a-2621-4d95-a286-bdfcc0a9d853 req-7077e97f-324e-471a-8931-3703597667d6 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:52.317755 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-2574011a-2621-4d95-a286-bdfcc0a9d853 req-7077e97f-324e-471a-8931-3703597667d6 service nova] Creating event network-changed:9ab698a3-e6c8-41e5-9918-2837ecadc50b for instance 87ef0c4e-a573-460d-aa95-239b4e897f74 on hv-cinder-80043 Jul 27 15:27:52.322742 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-2574011a-2621-4d95-a286-bdfcc0a9d853 req-7077e97f-324e-471a-8931-3703597667d6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029340 Jul 27 15:27:52.323316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 498/970] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:52.406219 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:52.406954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:52.413959 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:52.415084 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:52.415528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:52.416074 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:52.663742 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:52.671932 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:52.673933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:52.675797 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6d36737e-df49-4913-93c7-0d84218b491f tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.273242 Jul 27 15:27:52.677755 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2fbea5cd-1796-461c-adab-102cca35c6d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:52.679058 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2fbea5cd-1796-461c-adab-102cca35c6d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:52.686062 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2fbea5cd-1796-461c-adab-102cca35c6d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:52.686687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 473/971] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:52 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:52.687090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2fbea5cd-1796-461c-adab-102cca35c6d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:52.687967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2fbea5cd-1796-461c-adab-102cca35c6d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:52.688471 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2fbea5cd-1796-461c-adab-102cca35c6d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:52.789614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2fbea5cd-1796-461c-adab-102cca35c6d9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 37367 microversion: 2.1 time: 0.116730 Jul 27 15:27:52.790418 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 499/972] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:52 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 37367 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:27:53.693483 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:53.694083 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:53.700284 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:53.700724 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:53.701475 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:53.701902 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:53.801558 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-714f95a5-85ad-4780-8e8f-46477e1f6588 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:53.802703 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-714f95a5-85ad-4780-8e8f-46477e1f6588 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:53.809103 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-714f95a5-85ad-4780-8e8f-46477e1f6588 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:53.809545 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-714f95a5-85ad-4780-8e8f-46477e1f6588 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:53.810308 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-714f95a5-85ad-4780-8e8f-46477e1f6588 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:53.810767 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-714f95a5-85ad-4780-8e8f-46477e1f6588 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:53.838133 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:53.846160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:53.847697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:53.848819 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-dfd65c40-451c-4736-93ae-171de4e21a1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.159023 Jul 27 15:27:53.849375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 474/973] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:53 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:53.903121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-714f95a5-85ad-4780-8e8f-46477e1f6588 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 38205 microversion: 2.1 time: 0.105347 Jul 27 15:27:53.903756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 500/974] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:53 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 38205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:27:54.866874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:54.867480 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:54.873279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:54.873718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:54.874479 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:54.874912 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:54.915863 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-dde848f1-de6d-4140-9bd8-7a0603b81063 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:54.916843 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-dde848f1-de6d-4140-9bd8-7a0603b81063 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:54.923316 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dde848f1-de6d-4140-9bd8-7a0603b81063 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:54.923771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dde848f1-de6d-4140-9bd8-7a0603b81063 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:54.924531 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dde848f1-de6d-4140-9bd8-7a0603b81063 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:54.924958 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dde848f1-de6d-4140-9bd8-7a0603b81063 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:55.008441 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:55.016047 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:55.016917 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-dde848f1-de6d-4140-9bd8-7a0603b81063 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 38205 microversion: 2.1 time: 0.105052 Jul 27 15:27:55.017851 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:55.018000 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 501/975] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:54 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 38205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 15:27:55.018696 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1487988a-2e5c-4bf1-a973-277fadf127ad tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.156100 Jul 27 15:27:55.019739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 475/976] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:54 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:56.029611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-37d77eeb-458c-415d-b636-7e5147a39fd8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:56.030676 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-37d77eeb-458c-415d-b636-7e5147a39fd8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:56.036639 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:56.037233 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-37d77eeb-458c-415d-b636-7e5147a39fd8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:56.037344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:56.037635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-37d77eeb-458c-415d-b636-7e5147a39fd8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:56.038678 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-37d77eeb-458c-415d-b636-7e5147a39fd8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:56.039220 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-37d77eeb-458c-415d-b636-7e5147a39fd8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:56.044002 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:56.044509 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:56.045296 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:56.045786 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:56.121489 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-37d77eeb-458c-415d-b636-7e5147a39fd8 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 38205 microversion: 2.1 time: 0.095734 Jul 27 15:27:56.125734 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 502/977] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:56 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 38205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:56.179571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:56.187174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:56.188668 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:56.189796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-81f995e7-b61b-442e-9bb3-5a23fd8c8e0d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.156802 Jul 27 15:27:56.190352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 476/978] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:56 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:27:57.133374 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-d06ea9a3-02e2-438e-9536-eb1f3802fade tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:57.134376 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-d06ea9a3-02e2-438e-9536-eb1f3802fade tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:57.140734 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d06ea9a3-02e2-438e-9536-eb1f3802fade tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:57.141174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d06ea9a3-02e2-438e-9536-eb1f3802fade tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:57.141929 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d06ea9a3-02e2-438e-9536-eb1f3802fade tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:57.142353 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-d06ea9a3-02e2-438e-9536-eb1f3802fade tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:57.207876 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:57.208410 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:57.214135 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:57.214597 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:57.215367 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:57.215801 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:57.232232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-d06ea9a3-02e2-438e-9536-eb1f3802fade tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 38205 microversion: 2.1 time: 0.102664 Jul 27 15:27:57.233598 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 503/979] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:57 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 38205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:57.351805 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:57.359473 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:57.360953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:57.362090 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-01df7fd7-1adf-4e88-8840-f76a449cb143 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1745 microversion: 2.20 time: 0.157964 Jul 27 15:27:57.363214 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 477/980] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:57 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:27:58.244911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e817ddbd-57ad-4d8c-bf69-7beb23b59cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:58.245897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e817ddbd-57ad-4d8c-bf69-7beb23b59cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:58.252267 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e817ddbd-57ad-4d8c-bf69-7beb23b59cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:58.252707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e817ddbd-57ad-4d8c-bf69-7beb23b59cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:58.253537 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e817ddbd-57ad-4d8c-bf69-7beb23b59cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:58.253966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e817ddbd-57ad-4d8c-bf69-7beb23b59cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:58.367405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e817ddbd-57ad-4d8c-bf69-7beb23b59cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action" status: 200 len: 38333 microversion: 2.1 time: 0.126251 Jul 27 15:27:58.368346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 504/981] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:27:58 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/action => generated 38333 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:27:58.377565 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1b958a49-7cd3-451f-81ed-91a0fd003d69 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:58.378049 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1b958a49-7cd3-451f-81ed-91a0fd003d69 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:58.381272 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:58.381966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:58.384897 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b958a49-7cd3-451f-81ed-91a0fd003d69 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:58.385556 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b958a49-7cd3-451f-81ed-91a0fd003d69 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:58.386336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b958a49-7cd3-451f-81ed-91a0fd003d69 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:58.386808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1b958a49-7cd3-451f-81ed-91a0fd003d69 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:58.388418 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:58.388932 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:58.389637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:58.390161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:58.412556 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1b958a49-7cd3-451f-81ed-91a0fd003d69 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/ips" status: 200 len: 146 microversion: 2.1 time: 0.038651 Jul 27 15:27:58.413288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 478/982] 10.222.0.37 () {58 vars in 1248 bytes} [Tue Jul 27 15:27:58 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:27:58.528907 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:58.537727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:58.539442 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:58.540592 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-10d5a31c-2ccc-4af8-a829-1cad98731cfa tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1745 microversion: 2.20 time: 0.163759 Jul 27 15:27:58.541149 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 505/983] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:58 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:27:59.557722 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:27:59.558331 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:59.564058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:59.564572 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:59.565389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:59.565970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:59.727277 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:59.736837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:59.738446 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:27:59.739699 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7e72bb4a-893a-4193-bbd2-2ebb41ef0834 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.185768 Jul 27 15:27:59.740643 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 479/984] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:27:59 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:27:59.766510 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b93f20fd-24c5-44e5-9187-fae80e4daa3d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ef6780d-e0c3-4d3f-9bae-f8f47e068ee9"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:27:59.767564 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b93f20fd-24c5-44e5-9187-fae80e4daa3d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:27:59.774548 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b93f20fd-24c5-44e5-9187-fae80e4daa3d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:59.775212 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b93f20fd-24c5-44e5-9187-fae80e4daa3d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:27:59.776165 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b93f20fd-24c5-44e5-9187-fae80e4daa3d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:27:59.776600 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b93f20fd-24c5-44e5-9187-fae80e4daa3d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:00.090761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-b0c79ef9-e43b-4cfe-97db-b49291fd228f req-9bc23cd5-af81-4e30-b4bf-6c47f89fe991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832", "name": "network-vif-plugged", "status": "completed", "tag": "b1031221-38f6-4192-a8ea-b6744970a962"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:00.092789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:28:00.092789 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:28:00.101267 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-b0c79ef9-e43b-4cfe-97db-b49291fd228f req-9bc23cd5-af81-4e30-b4bf-6c47f89fe991 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:00.101986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-b0c79ef9-e43b-4cfe-97db-b49291fd228f req-9bc23cd5-af81-4e30-b4bf-6c47f89fe991 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:00.119761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-b0c79ef9-e43b-4cfe-97db-b49291fd228f req-9bc23cd5-af81-4e30-b4bf-6c47f89fe991 service nova] Creating event network-vif-plugged:b1031221-38f6-4192-a8ea-b6744970a962 for instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 on hv-cinder-80043 Jul 27 15:28:00.124882 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-b0c79ef9-e43b-4cfe-97db-b49291fd228f req-9bc23cd5-af81-4e30-b4bf-6c47f89fe991 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037880 Jul 27 15:28:00.125735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 480/985] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:28:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:00.265501 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b93f20fd-24c5-44e5-9187-fae80e4daa3d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502570 Jul 27 15:28:00.266299 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 506/986] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:27:59 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:00.763042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:00.763835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:00.772735 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:00.773192 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:00.774085 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:00.774955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:00.927001 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:00.936922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:00.939526 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:00.941306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-af729712-9bed-4f38-9436-1194d1f30970 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.182728 Jul 27 15:28:00.942795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 481/987] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:00 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:01.961923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:01.962674 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:01.969251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:01.969910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:01.970890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:01.971486 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:02.121639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:02.130247 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:02.131890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:02.133057 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-834e08fa-6b47-4adb-98fe-744c80c45495 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.175690 Jul 27 15:28:02.133621 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 507/988] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:01 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:03.152098 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:03.153632 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:03.160928 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:03.161683 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:03.162740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:03.163693 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:03.313524 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:03.321699 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:03.323514 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:03.324682 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3433fb32-0a94-47ac-b435-580c43e2fe49 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.177072 Jul 27 15:28:03.325251 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 482/989] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:03 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:04.343699 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:04.344336 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:04.351151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:04.351871 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:04.352888 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:04.353422 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:04.504978 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:04.517358 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:04.519505 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:04.520668 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-889afb4d-41e6-4b87-86bd-34e1b101519c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.180781 Jul 27 15:28:04.530966 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 508/990] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:04 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:05.541072 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:05.541806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:05.550486 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:05.550943 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:05.551922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:05.552363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:05.714430 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:05.722697 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:05.724218 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:05.725372 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-19d84f7e-c355-432b-92a9-a847b2fb0185 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.188196 Jul 27 15:28:05.725933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 483/991] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:05 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:28:06.743408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:06.744654 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:06.751052 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:06.751733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:06.763518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:06.764309 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:06.932462 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:06.942123 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:06.943746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:06.944974 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5175a8b0-934c-4e00-88be-047c5ade9b8b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.205288 Jul 27 15:28:06.957155 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 509/992] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:06 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:07.788962 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-fd055dae-166e-49c7-ae57-119875aa6fd7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:07.790508 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-fd055dae-166e-49c7-ae57-119875aa6fd7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:07.800385 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fd055dae-166e-49c7-ae57-119875aa6fd7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:07.801132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fd055dae-166e-49c7-ae57-119875aa6fd7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:07.802122 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fd055dae-166e-49c7-ae57-119875aa6fd7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:07.802580 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-fd055dae-166e-49c7-ae57-119875aa6fd7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:07.836226 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-fd055dae-166e-49c7-ae57-119875aa6fd7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051116 Jul 27 15:28:07.836796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 484/993] 10.222.0.37 () {58 vars in 1302 bytes} [Tue Jul 27 15:28:07 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:07.847134 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-21961f63-5f1d-4ca6-a53c-7aea8d7cfca7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:07.847713 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-21961f63-5f1d-4ca6-a53c-7aea8d7cfca7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:07.853691 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-21961f63-5f1d-4ca6-a53c-7aea8d7cfca7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:07.854137 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-21961f63-5f1d-4ca6-a53c-7aea8d7cfca7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:07.854950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-21961f63-5f1d-4ca6-a53c-7aea8d7cfca7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:07.855381 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-21961f63-5f1d-4ca6-a53c-7aea8d7cfca7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:07.890224 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-21961f63-5f1d-4ca6-a53c-7aea8d7cfca7 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/0ef6780d-e0c3-4d3f-9bae-f8f47e068ee9" status: 200 len: 194 microversion: 2.1 time: 0.047251 Jul 27 15:28:07.896231 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 510/994] 10.222.0.37 () {58 vars in 1413 bytes} [Tue Jul 27 15:28:07 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/0ef6780d-e0c3-4d3f-9bae-f8f47e068ee9 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:07.964111 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:07.964807 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:07.974909 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:07.975418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:07.976204 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:07.976960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:08.159630 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:08.180633 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:08.182883 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:08.184061 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-55b337e5-35ce-4d38-964e-e03b4214e782 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1740 microversion: 2.20 time: 0.223791 Jul 27 15:28:08.195428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 485/995] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:07 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:09.201653 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:09.202244 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:09.209866 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:09.210306 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:09.211128 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:09.211557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:09.243360 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9516fd74-2f60-47db-ae4e-c844e21d14ce tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa0d2f4b-99f9-43c4-a9e1-70faadb45f4b"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:09.244418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9516fd74-2f60-47db-ae4e-c844e21d14ce tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:09.250539 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9516fd74-2f60-47db-ae4e-c844e21d14ce tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:09.250991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9516fd74-2f60-47db-ae4e-c844e21d14ce tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:09.251775 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9516fd74-2f60-47db-ae4e-c844e21d14ce tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:09.252208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9516fd74-2f60-47db-ae4e-c844e21d14ce tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:09.511082 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9516fd74-2f60-47db-ae4e-c844e21d14ce tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271251 Jul 27 15:28:09.512312 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 486/996] 10.222.0.37 () {60 vars in 1323 bytes} [Tue Jul 27 15:28:09 2021] POST /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:09.621568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:09.629748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:09.631265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:09.632384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7f29bb47-0d95-4c67-a0c3-78b56a5a5f1a tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1722 microversion: 2.20 time: 0.434394 Jul 27 15:28:09.632925 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 511/997] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:09 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:10.650602 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:10.651288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:10.657679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:10.658121 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:10.659436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:10.659865 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:10.796711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:10.804369 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:10.805837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:10.806978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-68515d4b-185c-4ec2-b196-25d4731e2a65 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1722 microversion: 2.20 time: 0.160470 Jul 27 15:28:10.807531 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 487/998] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:10 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:11.824467 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:11.825069 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:11.830975 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:11.831429 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:11.832198 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:11.832631 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:11.963490 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:11.971176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:11.973189 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:11.974313 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-be8ea9ce-4c1f-47f7-b4ac-33f526010009 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1725 microversion: 2.20 time: 0.153617 Jul 27 15:28:11.975106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 512/999] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:11 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:11.991718 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d6dbe018-9f9d-4579-ac8b-09e18a04c879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72e37f83-ac1b-47fc-b078-90f8706755c7"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:11.992795 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d6dbe018-9f9d-4579-ac8b-09e18a04c879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:11.998644 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6dbe018-9f9d-4579-ac8b-09e18a04c879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:11.999088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6dbe018-9f9d-4579-ac8b-09e18a04c879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:11.999844 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6dbe018-9f9d-4579-ac8b-09e18a04c879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.000330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6dbe018-9f9d-4579-ac8b-09e18a04c879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.051645 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-3363d901-7a53-4710-8ec3-5e03a7728bcc req-56b2b6b8-b5e7-4b6a-a92a-a08b5224f2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832", "name": "network-vif-unplugged", "status": "completed", "tag": "b1031221-38f6-4192-a8ea-b6744970a962"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:12.053378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:28:12.053378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:28:12.060506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-3363d901-7a53-4710-8ec3-5e03a7728bcc req-56b2b6b8-b5e7-4b6a-a92a-a08b5224f2ec service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.061020 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-3363d901-7a53-4710-8ec3-5e03a7728bcc req-56b2b6b8-b5e7-4b6a-a92a-a08b5224f2ec service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.072444 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-3363d901-7a53-4710-8ec3-5e03a7728bcc req-56b2b6b8-b5e7-4b6a-a92a-a08b5224f2ec service nova] Creating event network-vif-unplugged:b1031221-38f6-4192-a8ea-b6744970a962 for instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 on hv-cinder-80043 Jul 27 15:28:12.077265 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-3363d901-7a53-4710-8ec3-5e03a7728bcc req-56b2b6b8-b5e7-4b6a-a92a-a08b5224f2ec service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029642 Jul 27 15:28:12.078261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 513/1000] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:28:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:12.256350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d6dbe018-9f9d-4579-ac8b-09e18a04c879 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.268981 Jul 27 15:28:12.256941 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 488/1001] 10.222.0.37 () {62 vars in 1364 bytes} [Tue Jul 27 15:28:11 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/os-volume_attachments => generated 188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 15:28:12.320373 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-12854218-fb1c-4cf5-9a3a-90bc8e562c35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:12.320946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-12854218-fb1c-4cf5-9a3a-90bc8e562c35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:12.326975 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12854218-fb1c-4cf5-9a3a-90bc8e562c35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.327422 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12854218-fb1c-4cf5-9a3a-90bc8e562c35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.328182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12854218-fb1c-4cf5-9a3a-90bc8e562c35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.328616 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-12854218-fb1c-4cf5-9a3a-90bc8e562c35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.578547 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-12854218-fb1c-4cf5-9a3a-90bc8e562c35 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/os-volume_attachments/72e37f83-ac1b-47fc-b078-90f8706755c7" status: 202 len: 0 microversion: 2.20 time: 0.262151 Jul 27 15:28:12.579128 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 514/1002] 10.222.0.37 () {60 vars in 1457 bytes} [Tue Jul 27 15:28:12 2021] DELETE /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/os-volume_attachments/72e37f83-ac1b-47fc-b078-90f8706755c7 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:28:12.636416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cf312e38-57fd-4818-b9be-3603f3aff187 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:12.637007 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cf312e38-57fd-4818-b9be-3603f3aff187 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:12.642794 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf312e38-57fd-4818-b9be-3603f3aff187 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.643881 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf312e38-57fd-4818-b9be-3603f3aff187 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.644631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf312e38-57fd-4818-b9be-3603f3aff187 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.645058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf312e38-57fd-4818-b9be-3603f3aff187 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.730292 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cf312e38-57fd-4818-b9be-3603f3aff187 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action" status: 202 len: 0 microversion: 2.20 time: 0.097299 Jul 27 15:28:12.731583 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 489/1003] 10.222.0.37 () {62 vars in 1319 bytes} [Tue Jul 27 15:28:12 2021] POST /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:28:12.738982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:12.739592 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:12.749879 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.750496 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.751410 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:12.751858 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:12.932748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:12.941194 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:12.942805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:12.944005 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2926f681-7bb0-4a9d-82bc-921f3861d14d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1673 microversion: 2.20 time: 0.208666 Jul 27 15:28:12.944661 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 515/1004] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:12 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:28:13.961379 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:13.962008 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:13.967946 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:13.968391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:13.969147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:13.969575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:14.190623 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:14.198350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:14.199857 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:14.200991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7793f951-0851-4c9f-bc8d-2fa09dfe0067 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.243318 Jul 27 15:28:14.201539 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 490/1005] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:13 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:15.220729 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:15.222719 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:15.228799 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:15.229449 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:15.230216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:15.230696 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:15.375557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:15.383349 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:15.384874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:15.386012 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f277e334-6faf-41ed-b0e5-f9178946086c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.169675 Jul 27 15:28:15.386582 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 516/1006] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:15 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:16.404115 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:16.404726 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:16.411133 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:16.411588 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:16.412365 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:16.412781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:16.557389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:16.564972 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:16.566448 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:16.567619 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-11a89b9b-452b-40f3-995d-6fa646de3c5c tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.167210 Jul 27 15:28:16.568169 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 491/1007] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:16 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:17.585640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:17.586492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:17.592936 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:17.593395 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:17.594174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:17.594643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:17.733783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:17.742771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:17.744307 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:17.745453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-94f61fa2-9deb-42d7-8190-c93d2494bac4 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.163794 Jul 27 15:28:17.746006 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 517/1008] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:17 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:28:18.763355 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:18.764124 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:18.771075 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:18.771516 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:18.772275 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:18.772706 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:18.927390 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:18.935184 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:18.936675 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:18.937813 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e94b9a79-2cfe-461a-8215-b999d1b81a77 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.178194 Jul 27 15:28:18.938368 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 492/1009] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:18 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:19.955236 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:19.955844 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:19.962177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:19.962664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:19.963431 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:19.963866 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:20.115139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:20.120751 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:20.122328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:20.123699 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0e8c9ea0-11f3-45ba-9fdb-c7663461c56b tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.171974 Jul 27 15:28:20.134792 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 518/1010] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:19 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:21.141665 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:21.142199 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:21.148634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:21.149087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:21.149866 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:21.150304 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:21.337524 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:21.345591 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:21.347716 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:21.348838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-66d0ed74-3d2a-4154-83b5-1f2799fdf6a6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.211367 Jul 27 15:28:21.349390 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 493/1011] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:21 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:22.367635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:22.368181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:22.373962 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:22.374400 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:22.375182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:22.375607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:22.522961 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:22.531747 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:22.533533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:22.534698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3a50eb42-fb1c-4aec-8807-c763e8e3cb2e tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.171538 Jul 27 15:28:22.535898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 519/1012] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:22 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:23.553414 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:23.554092 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:23.559994 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:23.560438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:23.561252 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:23.561692 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:23.712254 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:23.720625 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:23.722138 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:23.723324 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7c1ae8d4-e6dd-4d5b-92b0-0b4c40f59d40 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.174080 Jul 27 15:28:23.723884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 494/1013] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:23 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:24.740973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:24.741577 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:24.747440 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:24.747888 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:24.748697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:24.749079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:24.887050 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:24.895188 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:24.896690 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:24.899315 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6579b0db-d23d-4175-84e7-6264ec097f07 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.161934 Jul 27 15:28:24.900330 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 520/1014] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:24 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:25.917132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:25.917770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:25.923585 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:25.924039 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:25.924807 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:25.925250 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:26.059373 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:26.067452 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:26.068945 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:26.070068 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-44fd787a-b9f0-4aa1-a900-a497e88c95b7 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.156670 Jul 27 15:28:26.070656 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 495/1015] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:25 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:27.087740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:27.088351 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:27.094197 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:27.094685 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:27.095456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:27.095890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:27.228619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:27.236317 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:27.237986 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:27.239254 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6c24e2f4-4b6c-40d1-b24d-a02549eaa3f8 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.155269 Jul 27 15:28:27.240250 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 521/1016] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:27 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:27.719620 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-0fdbc03c-9244-4972-afd2-b00f5e31f711 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:27.720610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-0fdbc03c-9244-4972-afd2-b00f5e31f711 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:27.726980 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fdbc03c-9244-4972-afd2-b00f5e31f711 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:27.727429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fdbc03c-9244-4972-afd2-b00f5e31f711 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:27.728197 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fdbc03c-9244-4972-afd2-b00f5e31f711 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:27.728637 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-0fdbc03c-9244-4972-afd2-b00f5e31f711 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:27.757876 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-0fdbc03c-9244-4972-afd2-b00f5e31f711 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042025 Jul 27 15:28:27.758505 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 496/1017] 10.222.0.37 () {58 vars in 1302 bytes} [Tue Jul 27 15:28:27 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:28.017854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-25596766-5845-4604-a283-f4f390892a0d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:28.018339 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-25596766-5845-4604-a283-f4f390892a0d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:28.024123 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25596766-5845-4604-a283-f4f390892a0d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:28.024563 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25596766-5845-4604-a283-f4f390892a0d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:28.025345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25596766-5845-4604-a283-f4f390892a0d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:28.025772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-25596766-5845-4604-a283-f4f390892a0d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:28.054216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-25596766-5845-4604-a283-f4f390892a0d tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/0ef6780d-e0c3-4d3f-9bae-f8f47e068ee9" status: 200 len: 194 microversion: 2.1 time: 0.040162 Jul 27 15:28:28.054886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 522/1018] 10.222.0.37 () {58 vars in 1413 bytes} [Tue Jul 27 15:28:28 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/0ef6780d-e0c3-4d3f-9bae-f8f47e068ee9 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:28.064231 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:28.064727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:28.071235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:28.071687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:28.072463 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:28.072902 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:28.169815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lazy-loading 'services' on Instance uuid 7341803b-a406-4c1c-92e5-9d285e1953db {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:28:28.234774 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-38b04bc8-f0c8-4c04-9ff9-a9ac2301d8f2 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/0ef6780d-e0c3-4d3f-9bae-f8f47e068ee9" status: 202 len: 0 microversion: 2.1 time: 0.174184 Jul 27 15:28:28.235545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 497/1019] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:28:28 2021] DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/0ef6780d-e0c3-4d3f-9bae-f8f47e068ee9 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:28:28.260278 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:28.260890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:28.267287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:28.267812 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:28.268588 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:28.269043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:28.407607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:28.415851 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:28.417315 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:28.418430 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-246b5a87-3e71-4747-9a3e-53114ad77f31 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.161959 Jul 27 15:28:28.419002 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 523/1020] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:28 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:29.437185 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:29.437880 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:29.444524 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:29.444995 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:29.445761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:29.446199 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:29.579884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:29.587596 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:29.589094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:29.590227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2cb35f80-3e31-4186-9959-5fd04c3b8a97 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.157227 Jul 27 15:28:29.590821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 498/1021] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:29 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:30.203363 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-fca89d4c-f7d5-48d3-b36c-d5b450862465 req-3ca0fe51-eead-47a5-ab71-45fdced45eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832", "name": "network-vif-plugged", "status": "completed", "tag": "b1031221-38f6-4192-a8ea-b6744970a962"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:30.204944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:28:30.204944 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:28:30.213639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-fca89d4c-f7d5-48d3-b36c-d5b450862465 req-3ca0fe51-eead-47a5-ab71-45fdced45eb2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:30.214378 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-fca89d4c-f7d5-48d3-b36c-d5b450862465 req-3ca0fe51-eead-47a5-ab71-45fdced45eb2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:30.227566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-fca89d4c-f7d5-48d3-b36c-d5b450862465 req-3ca0fe51-eead-47a5-ab71-45fdced45eb2 service nova] Creating event network-vif-plugged:b1031221-38f6-4192-a8ea-b6744970a962 for instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 on hv-cinder-80043 Jul 27 15:28:30.236014 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-fca89d4c-f7d5-48d3-b36c-d5b450862465 req-3ca0fe51-eead-47a5-ab71-45fdced45eb2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036240 Jul 27 15:28:30.236886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 524/1022] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:28:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:30.415262 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d4a754df-1d15-422c-a19e-6be0ae60bca9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:30.415835 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d4a754df-1d15-422c-a19e-6be0ae60bca9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:30.421853 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d4a754df-1d15-422c-a19e-6be0ae60bca9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:30.422418 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d4a754df-1d15-422c-a19e-6be0ae60bca9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:30.423224 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d4a754df-1d15-422c-a19e-6be0ae60bca9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:30.423657 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d4a754df-1d15-422c-a19e-6be0ae60bca9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:30.455169 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d4a754df-1d15-422c-a19e-6be0ae60bca9 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/fa0d2f4b-99f9-43c4-a9e1-70faadb45f4b" status: 200 len: 194 microversion: 2.1 time: 0.044622 Jul 27 15:28:30.455783 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 499/1023] 10.222.0.37 () {58 vars in 1413 bytes} [Tue Jul 27 15:28:30 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/fa0d2f4b-99f9-43c4-a9e1-70faadb45f4b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:30.470171 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:30.470786 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:30.477266 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:30.477714 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:30.478509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:30.478948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:30.564888 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lazy-loading 'services' on Instance uuid 7341803b-a406-4c1c-92e5-9d285e1953db {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:28:30.607684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:30.608509 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:30.614592 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:30.615040 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:30.615808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:30.616235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:30.632771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-35c63eee-b533-4bbf-be8d-8b1d06848a8c tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/fa0d2f4b-99f9-43c4-a9e1-70faadb45f4b" status: 202 len: 0 microversion: 2.1 time: 0.166654 Jul 27 15:28:30.633362 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 525/1024] 10.222.0.37 () {58 vars in 1416 bytes} [Tue Jul 27 15:28:30 2021] DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db/os-volume_attachments/fa0d2f4b-99f9-43c4-a9e1-70faadb45f4b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:28:30.751318 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:30.759450 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:30.760942 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:30.762067 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a999236f-66a7-4583-ac7b-17843412fc12 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.158088 Jul 27 15:28:30.762656 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 500/1025] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:30 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 15:28:31.780762 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:31.781453 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:31.788429 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:31.788884 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:31.789651 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:31.790085 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:31.935422 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:31.943503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:31.944991 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:31.946100 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ec4f9a24-4147-4fe9-9796-d06af8714b7d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1731 microversion: 2.20 time: 0.169370 Jul 27 15:28:31.946726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 526/1026] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:31 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:32.964034 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:32.964669 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:32.970291 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:32.970821 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:32.971578 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:32.972010 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:32.998560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:32.999092 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:33.004950 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:33.005340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:33.006106 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:33.006575 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:33.030902 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:28:33.112139 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-90c36703-0d31-449b-9ec9-2884d8cd9cbf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 204 len: 0 microversion: 2.1 time: 0.116870 Jul 27 15:28:33.112741 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 527/1027] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:28:32 2021] DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 15:28:33.114679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:33.121389 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:33.122098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:33.122563 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:33.124055 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:33.125310 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-eaa2e5a5-4e9a-4d1a-bc8b-fe181ad95fe9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1718 microversion: 2.20 time: 0.164885 Jul 27 15:28:33.125857 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 501/1028] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:28:32 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:28:33.127857 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:33.128312 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:33.129076 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:33.129733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:33.264100 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:33.271776 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-349ac085-6b18-42ac-bdb5-59f744a94587 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1673 microversion: 2.1 time: 0.154113 Jul 27 15:28:33.272371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 528/1029] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:28:33 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:28:34.288711 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:34.289230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:34.295037 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:34.295483 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:34.296237 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:34.296687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:34.427544 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:34.434681 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f7f028a5-48fe-48b4-b253-a3acb95e9647 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1673 microversion: 2.1 time: 0.150450 Jul 27 15:28:34.435237 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 502/1030] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:28:34 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:35.451466 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:35.452113 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:35.458383 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:35.459049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:35.459830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:35.460267 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:35.696192 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02755482dd304f38a78fca1f4a199577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e48ce650f46378322af9bcc36686a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:28:35.703454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-32eab6a6-d685-40c1-9b88-1eaa44470daf tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 200 len: 1673 microversion: 2.1 time: 0.255769 Jul 27 15:28:35.704016 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 529/1031] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:28:35 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:36.110672 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-9a028415-6230-4c02-a447-b39a5f887791 req-58d34922-23c7-445f-87aa-770cf6efdb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7341803b-a406-4c1c-92e5-9d285e1953db", "name": "network-vif-deleted", "tag": "d0968775-43eb-4c43-81b7-a42592c816ca"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:36.112146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:28:36.112146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:28:36.120528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-9a028415-6230-4c02-a447-b39a5f887791 req-58d34922-23c7-445f-87aa-770cf6efdb8e service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:36.120959 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-9a028415-6230-4c02-a447-b39a5f887791 req-58d34922-23c7-445f-87aa-770cf6efdb8e service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:36.133164 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-9a028415-6230-4c02-a447-b39a5f887791 req-58d34922-23c7-445f-87aa-770cf6efdb8e service nova] Creating event network-vif-deleted:d0968775-43eb-4c43-81b7-a42592c816ca for instance 7341803b-a406-4c1c-92e5-9d285e1953db on hv-cinder-80043 Jul 27 15:28:36.142284 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-9a028415-6230-4c02-a447-b39a5f887791 req-58d34922-23c7-445f-87aa-770cf6efdb8e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035737 Jul 27 15:28:36.143391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 503/1032] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:28:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:36.720960 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:36.721646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:36.728626 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:36.729190 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:36.730317 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:36.730949 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:36.744372 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] HTTP exception thrown: Instance 7341803b-a406-4c1c-92e5-9d285e1953db could not be found. Jul 27 15:28:36.744987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Returning 404 to user: Instance 7341803b-a406-4c1c-92e5-9d285e1953db could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:28:36.745789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f675536f-cdc6-4351-996e-049a29941cbd tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 404 len: 111 microversion: 2.1 time: 0.029648 Jul 27 15:28:36.746327 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 530/1033] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:28:36 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:36.755852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2d51681a-915a-4f6b-b23d-946ee2194720 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '.version_select at 0x7f33f7615ca0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:36.774178 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2d51681a-915a-4f6b-b23d-946ee2194720 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582518869" status: 202 len: 0 microversion: 2.1 time: 0.022806 Jul 27 15:28:36.782609 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 504/1034] 10.222.0.37 () {58 vars in 1218 bytes} [Tue Jul 27 15:28:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582518869 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:28:39.851889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:39.852381 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:39.858175 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:39.858660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:39.859405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:39.859854 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:39.872939 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] HTTP exception thrown: Instance 7341803b-a406-4c1c-92e5-9d285e1953db could not be found. Jul 27 15:28:39.873502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Returning 404 to user: Instance 7341803b-a406-4c1c-92e5-9d285e1953db could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:28:39.874328 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a2de081a-0965-4f79-9394-27179ea98773 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 404 len: 111 microversion: 2.1 time: 0.026041 Jul 27 15:28:39.874872 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 531/1035] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:28:39 2021] DELETE /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:39.883168 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:39.883895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 7341803b-a406-4c1c-92e5-9d285e1953db] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:39.889836 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:39.890279 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:39.891070 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:39.891500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:39.904460 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] HTTP exception thrown: Instance 7341803b-a406-4c1c-92e5-9d285e1953db could not be found. Jul 27 15:28:39.905034 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Returning 404 to user: Instance 7341803b-a406-4c1c-92e5-9d285e1953db could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:28:39.905832 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d6fbed5d-2622-47b8-83e0-f35d7b96bdc6 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db" status: 404 len: 111 microversion: 2.1 time: 0.027252 Jul 27 15:28:39.906352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 505/1036] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:28:39 2021] GET /compute/v2.1/servers/7341803b-a406-4c1c-92e5-9d285e1953db => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:41.033371 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:41.033881 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:41.039931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:41.040369 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:41.041124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:41.041554 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:41.054261 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] HTTP exception thrown: Instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 could not be found. Jul 27 15:28:41.054861 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Returning 404 to user: Instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:28:41.055657 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bb272230-8033-4c57-87b7-f3269b3893aa tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 404 len: 111 microversion: 2.1 time: 0.025940 Jul 27 15:28:41.056161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 532/1037] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:28:41 2021] DELETE /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:41.063762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:41.064396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] [instance: 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:28:41.070704 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:41.071144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:41.071904 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:28:41.072330 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:28:41.085625 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] HTTP exception thrown: Instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 could not be found. Jul 27 15:28:41.086170 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] Returning 404 to user: Instance 4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:28:41.086996 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-74b00f22-2a7d-4750-816f-71b7edbf9b56 tempest-AttachVolumeTestJSON-393823174 tempest-AttachVolumeTestJSON-393823174-project] 10.222.0.37 "GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3" status: 404 len: 111 microversion: 2.1 time: 0.026876 Jul 27 15:28:41.087495 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 506/1038] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:28:41 2021] GET /compute/v2.1/servers/4b978b7b-a76a-4c2b-94d7-ecdd064ddad3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:28:45.431255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-edfc223f-a74b-4fe0-9915-ce57029e289e tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Action: 'create', calling method: .version_select at 0x7f33f7713dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2101214319", "metadata": {"Type": "work"}}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:28:45.718419 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-edfc223f-a74b-4fe0-9915-ce57029e289e tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.394350 Jul 27 15:28:45.719080 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 533/1039] 10.222.0.37 () {60 vars in 1156 bytes} [Tue Jul 27 15:28:45 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 15:28:45.730337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-53490b1b-14a3-460c-9cd0-cbae8515c28c tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Calling method '.version_select at 0x7f33f77d6ca0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:45.782739 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-53490b1b-14a3-460c-9cd0-cbae8515c28c tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494" status: 200 len: 353 microversion: 2.1 time: 0.055872 Jul 27 15:28:45.783335 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 507/1040] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:45 2021] GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:46.795680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-53c499bc-909b-4dab-bd70-9e7b7d7e34c3 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Calling method '.version_select at 0x7f3400554280>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:46.846179 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-53c499bc-909b-4dab-bd70-9e7b7d7e34c3 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494" status: 200 len: 354 microversion: 2.1 time: 0.054096 Jul 27 15:28:46.846784 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 534/1041] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:46 2021] GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:46.857281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7c75c56d-a1ef-42c8-86fa-b4687ec02894 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Calling method '.version_select at 0x7f3402094550>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:46.906832 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7c75c56d-a1ef-42c8-86fa-b4687ec02894 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494" status: 200 len: 354 microversion: 2.1 time: 0.053040 Jul 27 15:28:46.907377 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 508/1042] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:46 2021] GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:46.918610 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6a87ae38-2ed8-443e-959a-67cd181547d0 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Calling method '.version_select at 0x7f3400545ca0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:46.976186 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6a87ae38-2ed8-443e-959a-67cd181547d0 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494" status: 202 len: 0 microversion: 2.1 time: 0.061201 Jul 27 15:28:46.976962 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 535/1043] 10.222.0.37 () {58 vars in 1248 bytes} [Tue Jul 27 15:28:46 2021] DELETE /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:28:46.984337 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cf6f0444-91b1-49f0-a1b3-b93dda0a1d98 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Calling method '.version_select at 0x7f33f75e69d0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:47.035109 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cf6f0444-91b1-49f0-a1b3-b93dda0a1d98 tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494" status: 200 len: 353 microversion: 2.1 time: 0.054232 Jul 27 15:28:47.035666 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 509/1044] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:46 2021] GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:48.047790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-542bfade-57e5-4824-899f-36b3aa554e4e tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Calling method '.version_select at 0x7f3400554430>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:48.073915 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-542bfade-57e5-4824-899f-36b3aa554e4e tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] HTTP exception thrown: Volume 7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 could not be found. Jul 27 15:28:48.074525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-542bfade-57e5-4824-899f-36b3aa554e4e tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] Returning 404 to user: Volume 7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:28:48.075330 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-542bfade-57e5-4824-899f-36b3aa554e4e tempest-VolumesGetTestJSON-208723086 tempest-VolumesGetTestJSON-208723086-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494" status: 404 len: 109 microversion: 2.1 time: 0.031249 Jul 27 15:28:48.075839 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 536/1045] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:48 2021] GET /compute/v2.1/os-volumes/7a88fb1a-e1aa-4985-b3a3-ff1ab55b6494 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:28:50.688713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1830ed14-7b22-430c-a5d3-2b9f079b7f88 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f75e61f0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:50.740662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1830ed14-7b22-430c-a5d3-2b9f079b7f88 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/081777e3-974c-4635-ab90-8a301ad18043" status: 200 len: 351 microversion: 2.1 time: 0.055687 Jul 27 15:28:50.741375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 510/1046] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:50 2021] GET /compute/v2.1/os-volumes/081777e3-974c-4635-ab90-8a301ad18043 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:28:52.063540 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-883eb965-094c-4a56-bbf7-5e872af8f5fa tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f77669d0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:52.112740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-883eb965-094c-4a56-bbf7-5e872af8f5fa tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/d7ffb19f-4da3-45ba-92a3-c258f1ca4a45" status: 200 len: 350 microversion: 2.1 time: 0.052761 Jul 27 15:28:52.113293 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 537/1047] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:52 2021] GET /compute/v2.1/os-volumes/d7ffb19f-4da3-45ba-92a3-c258f1ca4a45 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:53.422612 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ba4c5648-a210-4402-8eb5-694555a57735 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f7662a60>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.471407 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ba4c5648-a210-4402-8eb5-694555a57735 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/0d48da39-39db-4747-94d8-0939a576465b" status: 200 len: 350 microversion: 2.1 time: 0.052451 Jul 27 15:28:53.472043 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 511/1048] 10.222.0.37 () {58 vars in 1245 bytes} [Tue Jul 27 15:28:53 2021] GET /compute/v2.1/os-volumes/0d48da39-39db-4747-94d8-0939a576465b => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:53.482620 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-132d220f-8c15-41c2-bf05-c8cb319de270 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f7fbdd30>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.561340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-132d220f-8c15-41c2-bf05-c8cb319de270 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082242 Jul 27 15:28:53.561927 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 538/1049] 10.222.0.37 () {58 vars in 1134 bytes} [Tue Jul 27 15:28:53 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:53.574260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d56bce40-a674-496d-9801-5661ce1d3b09 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f76720d0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.652203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d56bce40-a674-496d-9801-5661ce1d3b09 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.081486 Jul 27 15:28:53.652753 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 512/1050] 10.222.0.37 () {58 vars in 1149 bytes} [Tue Jul 27 15:28:53 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:53.664223 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-67c5c109-2721-42b9-8f3a-0884d775064c tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f3400554040>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.741823 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-67c5c109-2721-42b9-8f3a-0884d775064c tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.081334 Jul 27 15:28:53.742394 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 539/1051] 10.222.0.37 () {58 vars in 1134 bytes} [Tue Jul 27 15:28:53 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:53.753126 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-caed0732-a17d-49e3-96ea-3176e3834bdf tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f7615940>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.830152 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-caed0732-a17d-49e3-96ea-3176e3834bdf tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.080572 Jul 27 15:28:53.830754 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 513/1052] 10.222.0.37 () {58 vars in 1167 bytes} [Tue Jul 27 15:28:53 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:53.841771 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-fbab9711-b153-405f-b073-081a1a0bcc06 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f3400545700>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:53.920217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-fbab9711-b153-405f-b073-081a1a0bcc06 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.081880 Jul 27 15:28:53.920783 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 540/1053] 10.222.0.37 () {58 vars in 1170 bytes} [Tue Jul 27 15:28:53 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:53.932862 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7153ad3b-5d87-4117-9744-feab0f650db9 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f77d6040>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:54.011312 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7153ad3b-5d87-4117-9744-feab0f650db9 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.081960 Jul 27 15:28:54.011880 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 514/1054] 10.222.0.37 () {58 vars in 1155 bytes} [Tue Jul 27 15:28:53 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:28:54.022622 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-52e7bf01-e722-4997-a321-5a83cd41dc1e tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f34005459d0>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:54.102381 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-52e7bf01-e722-4997-a321-5a83cd41dc1e tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083233 Jul 27 15:28:54.102987 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 541/1055] 10.222.0.37 () {58 vars in 1188 bytes} [Tue Jul 27 15:28:54 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:28:54.114134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ccebfb75-5e50-4f24-bd31-be96a6ddcbc4 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] Calling method '.version_select at 0x7f33f75e6dc0>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:28:54.191325 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ccebfb75-5e50-4f24-bd31-be96a6ddcbc4 tempest-VolumesTestJSON-649465938 tempest-VolumesTestJSON-649465938-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.080641 Jul 27 15:28:54.191886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 515/1056] 10.222.0.37 () {58 vars in 1155 bytes} [Tue Jul 27 15:28:54 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:06.590841 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:06.591436 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:06.597065 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:06.597505 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:06.598592 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:06.599023 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:06.624656 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:29:06.703755 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-381dff6f-a1c1-402d-9483-2a59df88fe42 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 204 len: 0 microversion: 2.20 time: 0.116158 Jul 27 15:29:06.704894 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 542/1057] 10.222.0.37 () {60 vars in 1280 bytes} [Tue Jul 27 15:29:06 2021] DELETE /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 15:29:06.713604 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:06.714212 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:06.720154 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:06.720713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:06.721612 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:06.722099 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:06.865064 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.874125 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.875665 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:06.876927 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-276e23d0-7fc3-405a-a0fd-f77bbb0d44d0 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.167574 Jul 27 15:29:06.877989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 516/1058] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:29:06 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:07.896560 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:07.897746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:07.904463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:07.904907 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:07.905688 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:07.906129 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:08.185044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.195070 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.196770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:08.197915 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-485282d1-638d-46e7-a8d0-e5b2761cbe92 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1724 microversion: 2.20 time: 0.305439 Jul 27 15:29:08.198485 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 543/1059] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:29:07 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:09.216519 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:09.217451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:09.228659 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:09.229532 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:09.230950 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:09.231908 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:09.371969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:09.376675 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-46228598-0110-469d-bc6d-b66abceb6aed req-2f809e09-9742-4254-839c-a250f82ac135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832", "name": "network-vif-deleted", "tag": "b1031221-38f6-4192-a8ea-b6744970a962"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:09.378256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:29:09.378256 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:29:09.380259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:09.391163 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-46228598-0110-469d-bc6d-b66abceb6aed req-2f809e09-9742-4254-839c-a250f82ac135 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:09.391663 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-46228598-0110-469d-bc6d-b66abceb6aed req-2f809e09-9742-4254-839c-a250f82ac135 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:09.393652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b9cd998ab149299ffa176bc898c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65683f78756f4210b7c18932064a8ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:09.396306 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-56e13159-3464-4d9c-b9c0-e1da0d31ad2d tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 200 len: 1656 microversion: 2.20 time: 0.183435 Jul 27 15:29:09.399076 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 517/1060] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:29:09 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 1656 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 15:29:09.416436 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-46228598-0110-469d-bc6d-b66abceb6aed req-2f809e09-9742-4254-839c-a250f82ac135 service nova] Creating event network-vif-deleted:b1031221-38f6-4192-a8ea-b6744970a962 for instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 on hv-cinder-80043 Jul 27 15:29:09.426333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-46228598-0110-469d-bc6d-b66abceb6aed req-2f809e09-9742-4254-839c-a250f82ac135 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053076 Jul 27 15:29:09.426982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 544/1061] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:29:10.417417 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:10.418890 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:10.426833 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:10.427287 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:10.428077 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:10.432872 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:10.448862 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] HTTP exception thrown: Instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 could not be found. Jul 27 15:29:10.449720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Returning 404 to user: Instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:29:10.450991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-981913e0-e116-44dd-ab28-e19bcc0f79e6 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 404 len: 111 microversion: 2.20 time: 0.037131 Jul 27 15:29:10.451986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 518/1062] 10.222.0.37 () {60 vars in 1277 bytes} [Tue Jul 27 15:29:10 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 15:29:10.461645 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7daf2902-7981-4ac8-84b8-db89a182ba62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '.version_select at 0x7f33f7713040>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:10.487452 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7daf2902-7981-4ac8-84b8-db89a182ba62 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406813237" status: 204 len: 0 microversion: 2.20 time: 0.029932 Jul 27 15:29:10.488628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 545/1063] 10.222.0.37 () {60 vars in 1262 bytes} [Tue Jul 27 15:29:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406813237 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 15:29:12.489662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:12.490234 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:12.498100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:12.498575 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:12.499360 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:12.499805 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:12.515118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] HTTP exception thrown: Instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 could not be found. Jul 27 15:29:12.515707 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Returning 404 to user: Instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:29:12.516708 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-018dc440-2815-43d6-bf23-d946881b4513 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 404 len: 111 microversion: 2.1 time: 0.030724 Jul 27 15:29:12.517425 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 519/1064] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:29:12 2021] DELETE /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:29:12.525642 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:12.526364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:12.535425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:12.536454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:12.538143 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:12.539122 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:12.553877 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] HTTP exception thrown: Instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 could not be found. Jul 27 15:29:12.554789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Returning 404 to user: Instance 5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:29:12.555619 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-dc4da0a0-a3e1-4be9-872f-bfd2d7cbcb20 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832" status: 404 len: 111 microversion: 2.1 time: 0.034188 Jul 27 15:29:12.556163 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 546/1065] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:12 2021] GET /compute/v2.1/servers/5bf1b0e9-cbd4-47bf-9f07-9f40a7f8d832 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:29:13.698991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:13.702818 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:13.710066 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:13.710859 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:13.711898 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:13.712560 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:13.727607 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] HTTP exception thrown: Instance 330a8a79-8995-4ac2-b93f-656f98368132 could not be found. Jul 27 15:29:13.728428 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Returning 404 to user: Instance 330a8a79-8995-4ac2-b93f-656f98368132 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:29:13.729498 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-6f4ac1a8-29eb-4e58-a634-2428c96632f9 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "DELETE /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 404 len: 111 microversion: 2.1 time: 0.034274 Jul 27 15:29:13.730264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 520/1066] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:29:13 2021] DELETE /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:29:13.738557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:13.739102 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] [instance: 330a8a79-8995-4ac2-b93f-656f98368132] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:13.747772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:13.748719 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:13.749517 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:13.750124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:13.764566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] HTTP exception thrown: Instance 330a8a79-8995-4ac2-b93f-656f98368132 could not be found. Jul 27 15:29:13.765296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] Returning 404 to user: Instance 330a8a79-8995-4ac2-b93f-656f98368132 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:29:13.766397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ba9f3ef6-f489-4b0e-b11b-ffb7811288b1 tempest-AttachVolumeShelveTestJSON-119359647 tempest-AttachVolumeShelveTestJSON-119359647-project] 10.222.0.37 "GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132" status: 404 len: 111 microversion: 2.1 time: 0.031734 Jul 27 15:29:13.770794 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 547/1067] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:13 2021] GET /compute/v2.1/servers/330a8a79-8995-4ac2-b93f-656f98368132 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:29:18.854555 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c9ad5ea9-f488-41ff-a078-ee1416847652 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Action: 'create', calling method: .version_select at 0x7f33f7615700>, body: {"keypair": {"name": "tempest-TestShelveInstance-998460484"}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:18.875777 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c9ad5ea9-f488-41ff-a078-ee1416847652 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Getting quotas for project 8d408d4ffc5942fd9b0b500355b1e57a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:29:18.880146 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c9ad5ea9-f488-41ff-a078-ee1416847652 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Getting quotas for user 99293d568f82450f8becc49e2a3a163c and project 8d408d4ffc5942fd9b0b500355b1e57a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:29:19.033610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c9ad5ea9-f488-41ff-a078-ee1416847652 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Getting quotas for project 8d408d4ffc5942fd9b0b500355b1e57a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:29:19.037847 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-c9ad5ea9-f488-41ff-a078-ee1416847652 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Getting quotas for user 99293d568f82450f8becc49e2a3a163c and project 8d408d4ffc5942fd9b0b500355b1e57a. Resources: {'key_pairs'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:29:19.051283 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c9ad5ea9-f488-41ff-a078-ee1416847652 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.446803 Jul 27 15:29:19.054537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 521/1068] 10.222.0.37 () {60 vars in 1158 bytes} [Tue Jul 27 15:29:18 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:42.868229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1036734752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-998460484", "security_groups": [{"name": "tempest-secgroup-smoke-1530417381"}], "networks": [{"uuid": "13085574-034d-4ae3-85a6-d6576e439527"}], "block_device_mapping_v2": [{"uuid": "6baf81c0-3e03-41fb-896c-0bbc9acba59a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:42.971090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.network.neutron [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] validate_networks() for [('13085574-034d-4ae3-85a6-d6576e439527', None, None, None)] {{(pid=107332) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:29:43.433475 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Flavor limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:29:43.433891 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Image limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:29:43.434389 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Flavor pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:29:43.434815 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Image pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:29:43.435213 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:29:43.445314 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:43.445753 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:43.446565 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:43.447596 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:43.463357 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Getting quotas for project 8d408d4ffc5942fd9b0b500355b1e57a. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:29:43.467216 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Getting quotas for user 99293d568f82450f8becc49e2a3a163c and project 8d408d4ffc5942fd9b0b500355b1e57a. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:29:43.525958 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Going to run 1 instances... {{(pid=107332) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:29:43.528131 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6baf81c0-3e03-41fb-896c-0bbc9acba59a',volume_size=None,volume_type=None)] {{(pid=107332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:29:43.642722 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [51a5a7c1-4171-4190-826c-de15be7f1ae4] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 15:29:44.659306 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [51a5a7c1-4171-4190-826c-de15be7f1ae4] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 44152. Jul 27 15:29:44.663288 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5d858625-4f15-4229-94a8-4661dc08b5b4 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.798881 Jul 27 15:29:44.663922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 548/1069] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:29:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:29:44.673532 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-91682fff-7769-4323-a18a-68d76337239e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:44.674147 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-91682fff-7769-4323-a18a-68d76337239e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:44.729860 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-91682fff-7769-4323-a18a-68d76337239e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:44.737011 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-91682fff-7769-4323-a18a-68d76337239e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1088 microversion: 2.1 time: 0.067181 Jul 27 15:29:44.737561 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 522/1070] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:44 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:45.753014 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:45.753616 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:45.759503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:45.759948 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:45.760984 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:45.761218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:45.830810 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:45.837974 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f168a084-f4f8-4af8-a623-9d2c69d4be89 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1204 microversion: 2.1 time: 0.088612 Jul 27 15:29:45.839082 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 549/1071] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:45 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:46.855764 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:46.856300 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:46.862289 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:46.862840 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:46.863686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:46.864213 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:47.093522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:47.100729 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-781aa289-d421-44d4-95b3-1edd7a26fef9 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.249147 Jul 27 15:29:47.101292 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 523/1072] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:46 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:47.401882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-e4453e3c-26df-4b2f-842e-c5a818be0d96 req-17f5a716-6802-47bf-9258-c5587d84aaea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0", "tag": "b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:47.415726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:29:47.415726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:29:47.427817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-e4453e3c-26df-4b2f-842e-c5a818be0d96 req-17f5a716-6802-47bf-9258-c5587d84aaea service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:47.428563 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-e4453e3c-26df-4b2f-842e-c5a818be0d96 req-17f5a716-6802-47bf-9258-c5587d84aaea service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:47.442503 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-e4453e3c-26df-4b2f-842e-c5a818be0d96 req-17f5a716-6802-47bf-9258-c5587d84aaea service nova] Creating event network-changed:b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322 for instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 on hv-cinder-80043 Jul 27 15:29:47.450648 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-e4453e3c-26df-4b2f-842e-c5a818be0d96 req-17f5a716-6802-47bf-9258-c5587d84aaea service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052743 Jul 27 15:29:47.451426 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 550/1073] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:29:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:29:48.117903 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:48.118571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:48.124827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:48.125276 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:48.126042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:48.126492 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:48.349362 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:48.356799 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2582e660-5c46-4d10-883c-3c85a4dcb522 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.242675 Jul 27 15:29:48.357688 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 524/1074] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:48 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:49.373758 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:49.374375 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:49.380756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:49.381204 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:49.381981 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:49.382415 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:49.517452 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:49.524525 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7f52e25e-8eb0-4634-826f-105f5db9b500 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.155489 Jul 27 15:29:49.525080 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 551/1075] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:49 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:50.542734 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:50.543346 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:50.549189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:50.549634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:50.550398 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:50.550855 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:50.680209 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:50.688235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-80f26c45-fdd8-4491-a49f-b1ff696d37bf tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.149701 Jul 27 15:29:50.688930 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 525/1076] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:50 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:51.704693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:51.705304 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:51.711279 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:51.711726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:51.712484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:51.712911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:51.847792 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:51.854940 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e36ebb22-f1a4-49f4-9244-8729e3ddb730 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.153829 Jul 27 15:29:51.855518 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 552/1077] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:51 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:52.871464 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:52.872179 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:52.877965 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:52.878413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:52.879209 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:52.879640 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:53.086777 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:53.094548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4c3425b7-840f-47b5-80ad-b1af6bd1cc4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.226805 Jul 27 15:29:53.095106 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 526/1078] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:52 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:54.110928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:54.111484 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:54.117395 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:54.117918 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:54.118851 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:54.119387 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:54.259035 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:54.267549 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f33d5977-d63b-4473-ba89-2f61bd598f05 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.160333 Jul 27 15:29:54.268364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 553/1079] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:54 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:55.284927 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:55.285787 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:55.292130 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:55.292584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:55.293346 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:55.293778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:55.427855 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:55.435189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ef42f895-3a1d-4d38-b1c7-98f896f6903d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.153929 Jul 27 15:29:55.435762 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 527/1080] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:55 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:56.452557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:56.453227 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:56.459011 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:56.459459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:56.460220 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:56.460654 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:56.594298 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:56.601412 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f613eba9-7f76-4261-979b-2089d0ae41e1 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.152493 Jul 27 15:29:56.601973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 554/1081] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:56 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:57.239083 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:57.239648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:57.245404 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:57.245848 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:57.246631 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:57.247062 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:57.271996 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:29:57.343271 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-24e9cc52-7789-41d5-ade5-d968a9187ed9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "DELETE /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 204 len: 0 microversion: 2.1 time: 0.107468 Jul 27 15:29:57.343854 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 528/1082] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:29:57 2021] DELETE /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:29:57.352173 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:57.352927 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:57.358683 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:57.359136 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:57.359904 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:57.360340 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:57.495914 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:57.503492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f109192e-249c-455c-b4b7-89229aca60ba tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1577 microversion: 2.1 time: 0.155078 Jul 27 15:29:57.504054 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 555/1083] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:57 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:57.618687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:57.619380 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:57.625157 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:57.625597 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:57.626350 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:57.626806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:57.758923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:57.766674 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-5935d2fb-7848-4edc-bee5-690c872d533e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.152079 Jul 27 15:29:57.767230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 529/1084] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:57 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:29:58.075553 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-26db22b5-3110-4b4e-8f91-7e1436976507 req-202cecca-225f-4737-a151-498deb4a6f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0", "name": "network-vif-plugged", "status": "completed", "tag": "b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:29:58.077049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:29:58.077049 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:29:58.083799 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-26db22b5-3110-4b4e-8f91-7e1436976507 req-202cecca-225f-4737-a151-498deb4a6f35 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:58.084241 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-26db22b5-3110-4b4e-8f91-7e1436976507 req-202cecca-225f-4737-a151-498deb4a6f35 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:58.095093 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-26db22b5-3110-4b4e-8f91-7e1436976507 req-202cecca-225f-4737-a151-498deb4a6f35 service nova] Creating event network-vif-plugged:b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322 for instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 on hv-cinder-80043 Jul 27 15:29:58.099891 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-26db22b5-3110-4b4e-8f91-7e1436976507 req-202cecca-225f-4737-a151-498deb4a6f35 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028095 Jul 27 15:29:58.100469 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 556/1085] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:29:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:29:58.521009 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:58.521627 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:58.527925 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:58.528378 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:58.529142 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:58.529578 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:58.662301 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:58.670018 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-619f3d5b-070f-4b97-a7fd-2ca1fea9bd3b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1577 microversion: 2.1 time: 0.152900 Jul 27 15:29:58.670608 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 530/1086] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:58 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:58.783365 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:58.784019 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:58.790283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:58.790755 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:58.791566 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:58.791997 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:58.924047 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:58.931361 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-564e8861-cb03-40c4-a23e-eb8d5c22fd43 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.152031 Jul 27 15:29:58.931940 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 557/1087] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:58 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:59.687041 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:59.687645 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:59.693444 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:59.693888 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:59.694695 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:59.695126 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:59.825781 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:29:59.833016 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7b758d6b-244e-4348-bfb2-11375fe95a74 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1577 microversion: 2.1 time: 0.149564 Jul 27 15:29:59.833519 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 531/1088] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:59 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:29:59.947318 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:29:59.947928 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:29:59.953589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:59.954035 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:29:59.954820 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:29:59.955255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:00.109273 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:00.116434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-07696c11-ac7e-494d-9a08-6f1f77cc506f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1260 microversion: 2.1 time: 0.172787 Jul 27 15:30:00.116989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 558/1089] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:29:59 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:00.849741 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:00.850387 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:00.856171 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:00.856619 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:00.857388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:00.857825 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:00.992659 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:01.000675 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-ac7cb3d0-a3ec-4363-be8b-92d44b8f3063 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1577 microversion: 2.1 time: 0.154533 Jul 27 15:30:01.001189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 532/1090] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:00 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:01.132010 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:01.132725 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:01.138758 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:01.139405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:01.140161 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:01.140646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:01.363226 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:01.372564 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-e6e02237-0eea-4d7c-8228-ff5a938f781d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1444 microversion: 2.1 time: 0.244408 Jul 27 15:30:01.383595 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 559/1091] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:01 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1444 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:01.389056 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:01.389744 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:01.395895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:01.396183 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:01.396957 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:01.397388 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:01.684634 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:01.691802 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1e309a94-0542-42d8-9d8e-bd5091aeba5e tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1444 microversion: 2.1 time: 0.306480 Jul 27 15:30:01.692615 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 533/1092] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:01 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1444 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:02.017379 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:02.018113 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:02.024449 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:02.024910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:02.026455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:02.027157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:02.113361 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:02.121360 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-df90c1d0-2b6e-431b-8be9-0ca3da87d528 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1510 microversion: 2.1 time: 0.107682 Jul 27 15:30:02.122176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 560/1093] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:02 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1510 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:02.238546 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-85f9c306-9470-414f-aefc-e67915dd30bd req-ec52acfa-f47f-452e-a318-9476db4fa897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ef0c4e-a573-460d-aa95-239b4e897f74", "name": "network-vif-deleted", "tag": "9ab698a3-e6c8-41e5-9918-2837ecadc50b"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:02.243255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:02.243255 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:30:02.262734 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-85f9c306-9470-414f-aefc-e67915dd30bd req-ec52acfa-f47f-452e-a318-9476db4fa897 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:02.263451 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-85f9c306-9470-414f-aefc-e67915dd30bd req-ec52acfa-f47f-452e-a318-9476db4fa897 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:02.282050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-85f9c306-9470-414f-aefc-e67915dd30bd req-ec52acfa-f47f-452e-a318-9476db4fa897 service nova] Creating event network-vif-deleted:9ab698a3-e6c8-41e5-9918-2837ecadc50b for instance 87ef0c4e-a573-460d-aa95-239b4e897f74 on hv-cinder-80043 Jul 27 15:30:02.288564 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-85f9c306-9470-414f-aefc-e67915dd30bd req-ec52acfa-f47f-452e-a318-9476db4fa897 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057138 Jul 27 15:30:02.289662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 534/1094] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:03.138513 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:03.140140 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:03.147685 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:03.148658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:03.149733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:03.151491 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:03.205883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:03.206114 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:03.207141 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lazy-loading 'fault' on Instance uuid 87ef0c4e-a573-460d-aa95-239b4e897f74 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:30:03.266870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:03.278136 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9a541028-311e-45fc-9c92-5d4cea65f170 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 200 len: 1230 microversion: 2.1 time: 0.143782 Jul 27 15:30:03.279751 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 561/1095] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:03 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 1230 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:03.978907 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-30545c81-8d1c-40ef-b4e3-61e731fc665c req-a7ac499b-62e8-4f5a-b6d2-5cd0b2f9c582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0", "tag": "b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:03.979528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:03.979528 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:30:03.986416 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-30545c81-8d1c-40ef-b4e3-61e731fc665c req-a7ac499b-62e8-4f5a-b6d2-5cd0b2f9c582 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:03.986899 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-30545c81-8d1c-40ef-b4e3-61e731fc665c req-a7ac499b-62e8-4f5a-b6d2-5cd0b2f9c582 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:03.997684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-30545c81-8d1c-40ef-b4e3-61e731fc665c req-a7ac499b-62e8-4f5a-b6d2-5cd0b2f9c582 service nova] Creating event network-changed:b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322 for instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 on hv-cinder-80043 Jul 27 15:30:04.002318 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-30545c81-8d1c-40ef-b4e3-61e731fc665c req-a7ac499b-62e8-4f5a-b6d2-5cd0b2f9c582 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028217 Jul 27 15:30:04.002939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 535/1096] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:04.296635 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:04.297260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:04.303157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:04.303608 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:04.304382 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:04.304815 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:04.318580 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] HTTP exception thrown: Instance 87ef0c4e-a573-460d-aa95-239b4e897f74 could not be found. Jul 27 15:30:04.319177 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Returning 404 to user: Instance 87ef0c4e-a573-460d-aa95-239b4e897f74 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:30:04.320000 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3840ed60-912e-4289-92e4-4bf634888d01 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 404 len: 111 microversion: 2.1 time: 0.027041 Jul 27 15:30:04.320540 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 562/1097] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:04 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:30:04.432281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1522833209", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2028062658", "security_groups": [{"name": "tempest-secgroup-smoke-948308224"}], "block_device_mapping_v2": [{"uuid": "287afd19-7655-4a44-b35c-425e266b7f6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "16425a87-2cd0-48ad-8f02-b03806548cee"}]}} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:04.830831 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.network.neutron [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] validate_networks() for [('16425a87-2cd0-48ad-8f02-b03806548cee', None, None, None)] {{(pid=107333) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:30:05.288227 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Flavor limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:30:05.288796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Image limits 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:30:05.289119 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Flavor pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:30:05.289531 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Image pref 0:0:0 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:30:05.289978 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.virt.hardware [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:30:05.299538 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:05.299989 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:05.300808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:05.301245 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:05.317745 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for project e9a65d475c9846dfabea23794dd2e636. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:30:05.321679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.quota [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for user 56acc4e200664d4b850d1f84a946e576 and project e9a65d475c9846dfabea23794dd2e636. Resources: {'ram', 'cores', 'instances'} {{(pid=107333) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:30:05.382060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Going to run 1 instances... {{(pid=107333) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:30:05.384649 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='287afd19-7655-4a44-b35c-425e266b7f6a',volume_size=None,volume_type=None)] {{(pid=107333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:30:05.509701 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-48b7547e-7cd8-4fdc-95c3-a59f32d75e8d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.083334 Jul 27 15:30:05.515514 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 536/1098] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:30:04 2021] POST /compute/v2.1/servers => generated 405 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:30:05.520325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c373a755-200c-44b2-9325-be3845702562 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:05.520941 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c373a755-200c-44b2-9325-be3845702562 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:05.587683 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c373a755-200c-44b2-9325-be3845702562 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:05.594276 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c373a755-200c-44b2-9325-be3845702562 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1095 microversion: 2.1 time: 0.077501 Jul 27 15:30:05.594868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 563/1099] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:05 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:06.610585 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:06.611198 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:06.617134 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:06.617576 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:06.618457 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:06.618899 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:06.686336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:06.693994 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e1518ec0-638a-4154-a3a3-244c38a3717d tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1211 microversion: 2.1 time: 0.086968 Jul 27 15:30:06.695253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 537/1100] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:06 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:07.711865 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:07.712477 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:07.725283 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:07.725737 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:07.728185 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:07.729365 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:07.956021 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:07.964146 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-14ffd710-d370-41c9-9f43-8881f5ec2afe tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.255575 Jul 27 15:30:07.973934 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 564/1101] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:07 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:08.019452 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-4d0cccb5-9aee-43de-8288-355d3b08a944 req-ff21f484-7b33-4645-983d-a2bb72cc854f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650b1a2d-a516-43c0-97e2-a5a1becc6e51", "tag": "892469b6-0ff1-42ac-971b-744a28fd4453"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:08.020903 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:08.020903 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:30:08.031396 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-4d0cccb5-9aee-43de-8288-355d3b08a944 req-ff21f484-7b33-4645-983d-a2bb72cc854f service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:08.032088 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-4d0cccb5-9aee-43de-8288-355d3b08a944 req-ff21f484-7b33-4645-983d-a2bb72cc854f service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:08.045846 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-4d0cccb5-9aee-43de-8288-355d3b08a944 req-ff21f484-7b33-4645-983d-a2bb72cc854f service nova] Creating event network-changed:892469b6-0ff1-42ac-971b-744a28fd4453 for instance 650b1a2d-a516-43c0-97e2-a5a1becc6e51 on hv-cinder-80043 Jul 27 15:30:08.052033 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-4d0cccb5-9aee-43de-8288-355d3b08a944 req-ff21f484-7b33-4645-983d-a2bb72cc854f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036304 Jul 27 15:30:08.053103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 538/1102] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:30:08.980795 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:08.981789 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:08.990279 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:08.990997 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:08.993714 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:08.994383 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:09.205709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:09.215072 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-c8c4b2ee-a929-47fa-892b-26ea6c5d1ba9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.238577 Jul 27 15:30:09.215630 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 565/1103] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:08 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:10.232585 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:10.233226 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:10.239185 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:10.239626 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:10.240375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:10.240800 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:10.380399 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:10.388155 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-69d98335-3ae8-4ad6-8ffa-824401ecce81 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.160167 Jul 27 15:30:10.388713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 539/1104] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:10 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:11.404384 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:11.405000 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:11.411042 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:11.411488 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:11.412249 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:11.412680 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:11.548432 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:11.555504 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2511ed81-c464-4327-b872-552ac6169504 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.154799 Jul 27 15:30:11.556054 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 566/1105] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:11 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:12.572264 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:12.572882 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:12.579169 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:12.579610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:12.580434 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:12.580867 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:12.738533 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:12.746290 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-85207fb0-961c-4c71-b8b6-873bb88ccdf7 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.177610 Jul 27 15:30:12.746885 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 540/1106] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:12 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:13.762573 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:13.763175 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:13.768889 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:13.769329 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:13.770083 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:13.770535 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:13.903826 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:13.911472 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f2b91294-b965-4671-9b91-7f3f4eac8aa3 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.153020 Jul 27 15:30:13.912023 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 567/1107] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:13 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:30:14.931830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:14.932438 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:14.938281 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:14.938755 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:14.939503 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:14.939935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:15.075502 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:15.082693 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-51e1a656-5805-412c-a951-b2edf9a162c1 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.154365 Jul 27 15:30:15.083260 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 541/1108] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:14 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:16.099198 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:16.099740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:16.105973 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:16.106413 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:16.107254 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:16.107683 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:16.237568 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:16.245844 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1d6d88b0-26fb-4d89-9070-61b3d1c8ca75 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.149657 Jul 27 15:30:16.246408 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 568/1109] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:16 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:17.263226 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:17.263838 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:17.270034 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:17.270503 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:17.271323 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:17.271748 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:17.430230 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:17.438557 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-44d2ca93-77dc-4bd6-b477-3ebc333dd963 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.179725 Jul 27 15:30:17.439213 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 542/1110] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:17 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:18.454587 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:18.456009 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:18.462983 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:18.464247 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:18.465178 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:18.465611 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:18.602364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:18.609603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-857f77f8-9683-4304-b8fe-da516fd9a643 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.158545 Jul 27 15:30:18.610157 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 569/1111] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:18 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:19.196692 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-266ac016-abfb-47c8-9b99-470b9937c197 req-d23a10fb-d53c-4830-b7ee-c5b1cdb5ba33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650b1a2d-a516-43c0-97e2-a5a1becc6e51", "name": "network-vif-plugged", "status": "completed", "tag": "892469b6-0ff1-42ac-971b-744a28fd4453"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:19.198406 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:19.198406 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:30:19.201363 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa5fe9fb-01d5-44db-834e-17c7adfe68ea] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 15:30:19.206118 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-266ac016-abfb-47c8-9b99-470b9937c197 req-d23a10fb-d53c-4830-b7ee-c5b1cdb5ba33 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:19.206641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-266ac016-abfb-47c8-9b99-470b9937c197 req-d23a10fb-d53c-4830-b7ee-c5b1cdb5ba33 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:19.217792 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-266ac016-abfb-47c8-9b99-470b9937c197 req-d23a10fb-d53c-4830-b7ee-c5b1cdb5ba33 service nova] Creating event network-vif-plugged:892469b6-0ff1-42ac-971b-744a28fd4453 for instance 650b1a2d-a516-43c0-97e2-a5a1becc6e51 on hv-cinder-80043 Jul 27 15:30:19.222668 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-266ac016-abfb-47c8-9b99-470b9937c197 req-d23a10fb-d53c-4830-b7ee-c5b1cdb5ba33 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Jul 27 15:30:19.223253 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 543/1112] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:19.626088 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:19.626723 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:19.632413 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:19.632856 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:19.633606 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:19.634034 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:19.775557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:19.783538 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-62edee18-0b97-4fa4-b1c8-7349ffc9c546 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1266 microversion: 2.1 time: 0.160943 Jul 27 15:30:19.784036 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 570/1113] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:19 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:20.810796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:20.811583 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:20.818553 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:20.819008 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:20.819773 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:20.820207 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:20.834963 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa5fe9fb-01d5-44db-834e-17c7adfe68ea] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 44504. Jul 27 15:30:20.960340 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:20.968357 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3dc34528-ff6c-40ef-af23-3a3cb75f0a04 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1454 microversion: 2.1 time: 0.171990 Jul 27 15:30:20.968915 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 544/1114] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:20 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:20.985012 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:20.985622 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:20.988156 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b237722d-a0ec-493c-925a-14635ce6fa2d] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 15:30:20.992447 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:20.992886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:20.993640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:20.994068 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:21.142246 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:21.149510 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7df487de-30d5-4138-8548-2e987aa87829 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1454 microversion: 2.1 time: 0.168071 Jul 27 15:30:21.150243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 571/1115] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:20 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:22.835667 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-c5e5e826-bb51-4589-8719-c544f0fefa4b req-eb7e4385-8963-4b78-9a27-d0939748d617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650b1a2d-a516-43c0-97e2-a5a1becc6e51", "tag": "892469b6-0ff1-42ac-971b-744a28fd4453"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:22.837144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:22.837144 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:30:22.844686 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-c5e5e826-bb51-4589-8719-c544f0fefa4b req-eb7e4385-8963-4b78-9a27-d0939748d617 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:22.845108 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-c5e5e826-bb51-4589-8719-c544f0fefa4b req-eb7e4385-8963-4b78-9a27-d0939748d617 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:22.856836 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-c5e5e826-bb51-4589-8719-c544f0fefa4b req-eb7e4385-8963-4b78-9a27-d0939748d617 service nova] Creating event network-changed:892469b6-0ff1-42ac-971b-744a28fd4453 for instance 650b1a2d-a516-43c0-97e2-a5a1becc6e51 on hv-cinder-80043 Jul 27 15:30:22.861593 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-c5e5e826-bb51-4589-8719-c544f0fefa4b req-eb7e4385-8963-4b78-9a27-d0939748d617 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029487 Jul 27 15:30:22.862365 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 545/1116] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:45.793269 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1450852098", "imageRef": "86c7c5bb-96aa-4f6d-ac72-05443eac8351", "flavorRef": "452"}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:45.824260 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO oslo.messaging._drivers.impl_rabbit [-] [b237722d-a0ec-493c-925a-14635ce6fa2d] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 44728. Jul 27 15:30:45.858135 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.network.neutron [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] validate_networks() for None {{(pid=107332) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:30:46.361633 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Flavor limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:30:46.362046 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Image limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:30:46.362539 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Flavor pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:30:46.363013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Image pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:30:46.363417 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:30:46.371897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:46.372817 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:46.373600 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:46.374053 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:46.390129 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Getting quotas for project a045521b0f4b4f308f24110fa4a66a2a. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:30:46.393910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Getting quotas for user 4f7c59d874e74def994843e70032faa4 and project a045521b0f4b4f308f24110fa4a66a2a. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:30:46.405033 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Going to run 1 instances... {{(pid=107332) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:30:46.407287 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86c7c5bb-96aa-4f6d-ac72-05443eac8351',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:30:46.452424 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-35250e55-20e1-44ea-b6d2-156669467c7e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662785 Jul 27 15:30:46.453052 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 572/1117] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:30:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:30:46.463180 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-856f280e-f122-42a9-ad84-7b84620c3647 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:46.463931 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-856f280e-f122-42a9-ad84-7b84620c3647 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:46.517382 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-856f280e-f122-42a9-ad84-7b84620c3647 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:46.524256 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-856f280e-f122-42a9-ad84-7b84620c3647 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1215 microversion: 2.1 time: 0.065097 Jul 27 15:30:46.524815 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 546/1118] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:46 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:47.540986 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:47.541630 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:47.547894 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:47.548361 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:47.549142 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:47.549592 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:47.611813 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:47.618933 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-19b7893d-460e-457a-9daa-0a9db4d8e9c8 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1267 microversion: 2.1 time: 0.081783 Jul 27 15:30:47.619502 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 573/1119] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:47 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:48.636375 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:48.636984 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:48.644465 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:48.645138 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:48.646115 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:48.646765 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:48.903983 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:48.911409 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-71d2c74c-6bd2-4a95-8fc4-c980aeed8b26 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1315 microversion: 2.1 time: 0.278796 Jul 27 15:30:48.911970 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 547/1120] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:48 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:49.224255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-b7a8077a-6e5e-4be7-93bc-fc0e5688f3b7 req-abb26522-ced4-40d1-a3ac-3300b5d249c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb952ad-8dda-40ae-bd30-25e45c5059b5", "tag": "c2db5982-7696-4fa4-b022-b07772d922e1"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:49.225765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:49.225765 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:30:49.233285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-b7a8077a-6e5e-4be7-93bc-fc0e5688f3b7 req-abb26522-ced4-40d1-a3ac-3300b5d249c4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:49.234191 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-b7a8077a-6e5e-4be7-93bc-fc0e5688f3b7 req-abb26522-ced4-40d1-a3ac-3300b5d249c4 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:49.246360 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-b7a8077a-6e5e-4be7-93bc-fc0e5688f3b7 req-abb26522-ced4-40d1-a3ac-3300b5d249c4 service nova] Creating event network-changed:c2db5982-7696-4fa4-b022-b07772d922e1 for instance 9bb952ad-8dda-40ae-bd30-25e45c5059b5 on hv-cinder-80043 Jul 27 15:30:49.252346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-b7a8077a-6e5e-4be7-93bc-fc0e5688f3b7 req-abb26522-ced4-40d1-a3ac-3300b5d249c4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031625 Jul 27 15:30:49.253195 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 574/1121] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:49.928615 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:49.929233 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:49.935167 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:49.935552 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:49.936317 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:49.936749 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:50.153050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:50.160830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d06bd273-2e90-4d60-97cb-7d62158cb50b tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1315 microversion: 2.1 time: 0.235875 Jul 27 15:30:50.161429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 548/1122] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:49 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:51.177550 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:51.178174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:51.184252 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:51.184695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:51.185447 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:51.185873 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:51.318255 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:51.325897 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a6f103df-b182-4e75-a516-a36ea5e2d33f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1315 microversion: 2.1 time: 0.152034 Jul 27 15:30:51.326454 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 575/1123] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:51 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:52.342307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:52.342935 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:52.348698 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:52.349137 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:52.349889 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:52.350316 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:52.510387 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:52.517520 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-892b8ccf-6bdb-49c2-ad76-4cd464e3b91c tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1315 microversion: 2.1 time: 0.179452 Jul 27 15:30:52.518093 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 549/1124] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:52 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:53.376607 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-275fee8a-1998-4614-a4b5-d9ae15f40720 req-b37148f0-2bf7-4b80-b4ad-d4ccd7ce5346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb952ad-8dda-40ae-bd30-25e45c5059b5", "name": "network-vif-plugged", "status": "completed", "tag": "c2db5982-7696-4fa4-b022-b07772d922e1"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:53.378090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:53.378090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:30:53.385266 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-275fee8a-1998-4614-a4b5-d9ae15f40720 req-b37148f0-2bf7-4b80-b4ad-d4ccd7ce5346 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:53.385726 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-275fee8a-1998-4614-a4b5-d9ae15f40720 req-b37148f0-2bf7-4b80-b4ad-d4ccd7ce5346 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:53.398675 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-275fee8a-1998-4614-a4b5-d9ae15f40720 req-b37148f0-2bf7-4b80-b4ad-d4ccd7ce5346 service nova] Creating event network-vif-plugged:c2db5982-7696-4fa4-b022-b07772d922e1 for instance 9bb952ad-8dda-40ae-bd30-25e45c5059b5 on hv-cinder-80043 Jul 27 15:30:53.403455 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-275fee8a-1998-4614-a4b5-d9ae15f40720 req-b37148f0-2bf7-4b80-b4ad-d4ccd7ce5346 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030478 Jul 27 15:30:53.404238 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 576/1125] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:53.533042 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:53.533616 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:53.539652 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:53.540097 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:53.540923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:53.541361 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:53.734666 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:53.741841 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a76b6106-8900-4d32-b7f2-a8d2c115be5e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1315 microversion: 2.1 time: 0.212533 Jul 27 15:30:53.742399 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 550/1126] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:53 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:54.759285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:54.759970 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:54.766417 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:54.766877 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:54.767626 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:54.768052 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:54.907650 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:54.915075 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1f4597da-aa87-4aac-8083-3523750603c9 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1315 microversion: 2.1 time: 0.159753 Jul 27 15:30:54.915638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 577/1127] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:54 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:55.931738 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:55.932352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:55.938235 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:55.938719 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:55.939484 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:55.939922 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:56.071453 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.079259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-db5988fa-75ef-4cd4-89e1-4031c86fd387 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1464 microversion: 2.1 time: 0.151213 Jul 27 15:30:56.079826 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 551/1128] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:55 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:56.114479 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:56.114982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:56.120648 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:56.121098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:56.122422 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:56.122881 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:56.146735 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Going to try to terminate instance {{(pid=107332) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:30:56.218954 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-56bb3954-0d75-4c02-b0a0-0dfe5c72386f tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 204 len: 0 microversion: 2.1 time: 0.107665 Jul 27 15:30:56.219551 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 578/1129] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:30:56 2021] DELETE /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:30:56.227626 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:56.228241 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:56.234002 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:56.234452 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:56.235247 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:56.235684 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:56.371269 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:56.378941 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-57fd9f32-3a6f-46ad-b032-ea295d1795f7 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1470 microversion: 2.1 time: 0.154876 Jul 27 15:30:56.379512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 552/1130] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:56 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:57.397199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:57.397811 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:57.404159 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:57.404604 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:57.405361 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:57.405792 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:57.538638 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:57.546492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6c8d9280-d90b-45ab-9bbd-3eef24dfc96e tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1470 microversion: 2.1 time: 0.153480 Jul 27 15:30:57.547174 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 579/1131] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:57 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:58.272993 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-66bf6df8-a7ca-45c4-a6f8-ea6dcb7dd5a2 req-73b5f2cc-2ddf-47ac-b465-015328c677d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb952ad-8dda-40ae-bd30-25e45c5059b5", "name": "network-vif-deleted", "tag": "c2db5982-7696-4fa4-b022-b07772d922e1"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:30:58.274522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:30:58.274522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:30:58.282058 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-66bf6df8-a7ca-45c4-a6f8-ea6dcb7dd5a2 req-73b5f2cc-2ddf-47ac-b465-015328c677d5 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:58.282520 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-66bf6df8-a7ca-45c4-a6f8-ea6dcb7dd5a2 req-73b5f2cc-2ddf-47ac-b465-015328c677d5 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:58.294662 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-66bf6df8-a7ca-45c4-a6f8-ea6dcb7dd5a2 req-73b5f2cc-2ddf-47ac-b465-015328c677d5 service nova] Creating event network-vif-deleted:c2db5982-7696-4fa4-b022-b07772d922e1 for instance 9bb952ad-8dda-40ae-bd30-25e45c5059b5 on hv-cinder-80043 Jul 27 15:30:58.300332 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-66bf6df8-a7ca-45c4-a6f8-ea6dcb7dd5a2 req-73b5f2cc-2ddf-47ac-b465-015328c677d5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030838 Jul 27 15:30:58.303827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 553/1132] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:30:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:30:58.563891 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:58.564416 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:58.570132 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:58.570614 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:58.571379 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:58.571809 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:58.600862 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:58.601300 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:58.601742 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lazy-loading 'fault' on Instance uuid 9bb952ad-8dda-40ae-bd30-25e45c5059b5 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:30:58.642399 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7c59d874e74def994843e70032faa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a045521b0f4b4f308f24110fa4a66a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:30:58.649441 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-524f9f8c-9686-4178-8627-0bd0d5021dd4 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 200 len: 1305 microversion: 2.1 time: 0.089318 Jul 27 15:30:58.649998 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 580/1133] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:58 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:30:59.667398 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:30:59.668094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] [instance: 9bb952ad-8dda-40ae-bd30-25e45c5059b5] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:30:59.674617 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:59.675066 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:59.675827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:30:59.676259 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:30:59.689401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] HTTP exception thrown: Instance 9bb952ad-8dda-40ae-bd30-25e45c5059b5 could not be found. Jul 27 15:30:59.689968 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] Returning 404 to user: Instance 9bb952ad-8dda-40ae-bd30-25e45c5059b5 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:30:59.690810 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-400a6f40-1f5b-4c0d-a44b-4ac7cfac54c2 tempest-VolumesNegativeTest-1072377620 tempest-VolumesNegativeTest-1072377620-project] 10.222.0.37 "GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5" status: 404 len: 111 microversion: 2.1 time: 0.027458 Jul 27 15:30:59.691316 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 554/1134] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:30:59 2021] GET /compute/v2.1/servers/9bb952ad-8dda-40ae-bd30-25e45c5059b5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:32:03.463953 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:03.464565 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:03.470268 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:03.470741 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:03.471509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:03.471941 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:03.493690 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lazy-loading 'flavor' on Instance uuid 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:32:03.563599 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3c4e0559-b267-46bc-9d96-9fe71f9976c6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "POST /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0/action" status: 202 len: 0 microversion: 2.1 time: 0.104321 Jul 27 15:32:03.564160 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 581/1135] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:32:03 2021] POST /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:32:03.574994 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:03.575601 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:03.581959 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:03.582401 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:03.583189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:03.583617 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:03.823334 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:03.830410 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-d6a6c14c-862b-4bd1-bf03-afadf30741d2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.259994 Jul 27 15:32:03.831311 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 555/1136] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:03 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:04.848320 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:04.849018 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:04.855045 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:04.855494 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:04.856264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:04.856698 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:05.035236 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:05.042447 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2e4ed1d9-dc17-4988-9677-487988b1fcc2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.198147 Jul 27 15:32:05.043029 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 582/1137] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:04 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:06.059816 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:06.060429 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:06.066412 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:06.066895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:06.067658 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:06.068094 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:06.202100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:06.209874 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-007fda29-e1bd-4720-bc85-c9001ee63d84 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.153849 Jul 27 15:32:06.210423 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 556/1138] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:06 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:07.227264 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:07.227830 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:07.233748 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:07.234189 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:07.234976 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:07.235407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:07.371618 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:07.378758 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-bcc5155b-9084-428e-bdf0-cbcee67a3e3d tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.155687 Jul 27 15:32:07.379322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 583/1139] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:07 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:08.395376 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:08.395925 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:08.401827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:08.402272 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:08.403060 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:08.403495 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:08.537545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:08.545919 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a337ed28-95e6-411e-a5ef-3664ffe5d025 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.154288 Jul 27 15:32:08.546516 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 557/1140] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:08 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:09.563242 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:09.563852 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:09.569645 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:09.570090 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:09.570880 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:09.571345 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:09.700818 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:09.708565 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0dbbd2d9-f0c3-4226-8178-bbfdd107b503 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.148990 Jul 27 15:32:09.709124 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 584/1141] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:09 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:10.724806 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:10.725419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:10.731192 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:10.731638 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:10.732393 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:10.732824 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:10.863338 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:10.871233 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-83ea572c-58e9-472c-9529-292fd6cce09f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.150069 Jul 27 15:32:10.871796 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 558/1142] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:10 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:11.887813 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:11.888346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:11.894043 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:11.894506 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:11.895855 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:11.896285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:12.031574 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:12.038931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-a4e09798-4671-4037-97cb-79dbe15587a6 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.154828 Jul 27 15:32:12.039482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 585/1143] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:11 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:13.056434 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:13.057046 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:13.062879 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:13.063328 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:13.064087 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:13.064516 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:13.195820 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:13.203092 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f040251b-0a8d-4f65-bbec-e2686eb91c7b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.150529 Jul 27 15:32:13.203646 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 559/1144] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:13 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:14.219694 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:14.220663 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:14.227296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:14.227739 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:14.228544 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:14.228972 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:14.536882 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:14.544485 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-8602adb3-7448-4d3b-a999-aed680ab3080 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.328305 Jul 27 15:32:14.545077 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 586/1145] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:14 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:15.560740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:15.561344 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:15.567352 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:15.567791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:15.568544 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:15.568971 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:15.698585 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:15.705685 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-3ed70b5b-67c6-4bf1-b006-5febc7838540 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.148565 Jul 27 15:32:15.706243 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 560/1146] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:15 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:16.722623 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:16.723235 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:16.729130 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:16.729573 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:16.730325 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:16.730782 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:16.860397 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:16.867636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b532fac5-c274-4904-baf8-15b8d2128f28 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.148650 Jul 27 15:32:16.868201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 587/1147] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:16 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:17.885345 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:17.885863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:17.891610 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:17.892057 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:17.892819 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:17.893242 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:18.027898 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:18.035502 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-84b603be-cf12-494c-89ee-fcbbeca04397 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.153911 Jul 27 15:32:18.036065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 561/1148] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:17 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:19.051922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:19.052530 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:19.058218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:19.058697 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:19.059510 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:19.059937 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:19.193253 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:19.200628 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-20e7fd68-0d41-4bea-84f9-a5f3913d7439 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.152478 Jul 27 15:32:19.201221 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 588/1149] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:19 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:20.218730 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:20.219341 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:20.225223 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:20.225663 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:20.226404 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:20.226852 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:20.358584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:20.366221 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e6b476aa-cdbe-4eb8-948f-adb44abbc762 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.151178 Jul 27 15:32:20.366923 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 562/1150] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:20 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:21.387822 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:21.388370 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:21.394114 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:21.394587 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:21.395337 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:21.395763 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:21.526194 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:21.533613 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-b9ec9fc7-2a7f-4d75-ae3e-cea25da810f8 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.149515 Jul 27 15:32:21.534163 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 589/1151] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:21 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:21.860089 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-72e04c47-a41a-40d8-8606-eae6c81c8921 req-3adecae1-a793-4948-bed4-7ac25e301028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0", "name": "network-vif-unplugged", "status": "completed", "tag": "b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:21.861738 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:32:21.861738 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:32:21.869761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-72e04c47-a41a-40d8-8606-eae6c81c8921 req-3adecae1-a793-4948-bed4-7ac25e301028 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:21.870311 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-72e04c47-a41a-40d8-8606-eae6c81c8921 req-3adecae1-a793-4948-bed4-7ac25e301028 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:21.882567 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-72e04c47-a41a-40d8-8606-eae6c81c8921 req-3adecae1-a793-4948-bed4-7ac25e301028 service nova] Creating event network-vif-unplugged:b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322 for instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 on hv-cinder-80043 Jul 27 15:32:21.887465 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-72e04c47-a41a-40d8-8606-eae6c81c8921 req-3adecae1-a793-4948-bed4-7ac25e301028 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031212 Jul 27 15:32:21.888244 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 563/1152] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:32:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:22.144285 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1399054994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2028062658", "security_groups": [{"name": "tempest-secgroup-smoke-948308224"}], "block_device_mapping_v2": [{"uuid": "6b7b1653-4c10-4aa4-9a90-a2a4b4d1fff5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "16425a87-2cd0-48ad-8f02-b03806548cee"}]}} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:22.245167 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.network.neutron [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] validate_networks() for [('16425a87-2cd0-48ad-8f02-b03806548cee', None, None, None)] {{(pid=107332) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 27 15:32:22.551336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:22.552113 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:22.558886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.559437 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.560263 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.560758 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.666967 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Flavor limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 15:32:22.667456 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Image limits 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 15:32:22.668066 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Flavor pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 15:32:22.668470 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Image pref 0:0:0 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 15:32:22.668875 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.virt.hardware [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 15:32:22.678064 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.679179 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.679982 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.680416 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.697006 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for project e9a65d475c9846dfabea23794dd2e636. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 27 15:32:22.700874 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.quota [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Getting quotas for user 56acc4e200664d4b850d1f84a946e576 and project e9a65d475c9846dfabea23794dd2e636. Resources: {'ram', 'cores', 'instances'} {{(pid=107332) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 27 15:32:22.725176 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:22.732613 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-18223c11-3f9c-466f-b53f-ea8b3de4316f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1510 microversion: 2.1 time: 0.185225 Jul 27 15:32:22.733179 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 564/1153] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:22 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:22.749112 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-90633aa6-4be0-4ecf-9d92-96a0b60bca4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:22.749677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-90633aa6-4be0-4ecf-9d92-96a0b60bca4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:22.755391 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90633aa6-4be0-4ecf-9d92-96a0b60bca4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.755837 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90633aa6-4be0-4ecf-9d92-96a0b60bca4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.757208 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90633aa6-4be0-4ecf-9d92-96a0b60bca4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.757641 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-90633aa6-4be0-4ecf-9d92-96a0b60bca4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.761850 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Going to run 1 instances... {{(pid=107332) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 27 15:32:22.763990 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b7b1653-4c10-4aa4-9a90-a2a4b4d1fff5',volume_size=None,volume_type=None)] {{(pid=107332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 27 15:32:22.831317 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-90633aa6-4be0-4ecf-9d92-96a0b60bca4f tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "POST /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0/action" status: 202 len: 0 microversion: 2.1 time: 0.085586 Jul 27 15:32:22.834986 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 565/1154] 10.222.0.37 () {60 vars in 1278 bytes} [Tue Jul 27 15:32:22 2021] POST /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 15:32:22.839600 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:22.840614 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:22.846021 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.846512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.847294 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:22.847736 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:22.903959 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-14537c7f-e1df-4d16-ba68-f12240cb2380 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763318 Jul 27 15:32:22.905232 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 590/1155] 10.222.0.37 () {60 vars in 1147 bytes} [Tue Jul 27 15:32:22 2021] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 15:32:22.915181 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f0312d7c-0046-4794-92ac-05c0e08e0f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:22.916302 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f0312d7c-0046-4794-92ac-05c0e08e0f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:23.008912 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f0312d7c-0046-4794-92ac-05c0e08e0f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:23.015245 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f0312d7c-0046-4794-92ac-05c0e08e0f9a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1095 microversion: 2.1 time: 0.104051 Jul 27 15:32:23.016239 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 591/1156] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:22 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:23.081078 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:23.100966 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-f8891248-209a-4474-98a6-c517f583598c tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1518 microversion: 2.1 time: 0.264226 Jul 27 15:32:23.105160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 566/1157] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:22 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:24.032121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:24.032736 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:24.039254 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:24.039695 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:24.040459 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:24.040890 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:24.107805 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:24.115251 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3bd8fd94-f412-4a46-bf0b-3957495d3b83 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1193 microversion: 2.1 time: 0.086969 Jul 27 15:32:24.115848 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 592/1158] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:24 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:24.117801 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:24.118501 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:24.124827 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:24.125343 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:24.126613 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:24.127282 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:24.349791 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:24.361138 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cc78812b-25f8-497d-9185-85eeb27ba5e0 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1520 microversion: 2.1 time: 0.247400 Jul 27 15:32:24.361720 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 567/1159] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:24 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:25.133039 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:25.134637 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:25.141338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:25.142072 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:25.143042 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:25.143686 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:25.378423 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:25.379744 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:25.380107 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:25.387256 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:25.388149 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:25.389189 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:25.389960 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:25.390921 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-ca5f67d2-1b73-4bea-8206-8549d9e4bd92 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.262348 Jul 27 15:32:25.401613 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 593/1160] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:25 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:25.638389 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:25.648770 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-560eb46b-1b59-4230-9d4f-8002ad380948 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.274315 Jul 27 15:32:25.659246 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 568/1161] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:25 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:25.862282 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-3090fced-a3fc-47ae-89a6-0f77fb35d064 req-9f923740-8291-4a26-8af1-3343368cf7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d872d5-665e-46be-9f34-856441ac0b06", "tag": "9c2d5624-5a13-4e47-a504-f32fcb79febc"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:25.863881 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:32:25.863881 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:32:25.871218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-3090fced-a3fc-47ae-89a6-0f77fb35d064 req-9f923740-8291-4a26-8af1-3343368cf7b2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:25.871664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-3090fced-a3fc-47ae-89a6-0f77fb35d064 req-9f923740-8291-4a26-8af1-3343368cf7b2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:25.883833 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-3090fced-a3fc-47ae-89a6-0f77fb35d064 req-9f923740-8291-4a26-8af1-3343368cf7b2 service nova] Creating event network-changed:9c2d5624-5a13-4e47-a504-f32fcb79febc for instance 58d872d5-665e-46be-9f34-856441ac0b06 on hv-cinder-80043 Jul 27 15:32:25.889648 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-3090fced-a3fc-47ae-89a6-0f77fb35d064 req-9f923740-8291-4a26-8af1-3343368cf7b2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105827 Jul 27 15:32:25.891038 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 594/1162] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:32:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:26.408332 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:26.408886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:26.414752 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:26.415203 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:26.415967 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:26.416400 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:26.648589 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:26.655756 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-59d59283-dd1d-471a-bbcb-f315d48acb23 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.251494 Jul 27 15:32:26.656312 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 569/1163] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:26 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:26.670349 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:26.671175 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:26.676978 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:26.677425 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:26.678178 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:26.678636 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:27.137957 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:27.145355 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-6ea84ba1-0540-4788-b7be-1266a57a4acc tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.479140 Jul 27 15:32:27.145911 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 595/1164] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:26 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:27.672307 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:27.672917 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:27.678764 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:27.679205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:27.679953 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:27.680381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:27.822285 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:27.829633 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-b24dc349-3da2-4f26-a716-1742962735fa tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.161001 Jul 27 15:32:27.830195 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 570/1165] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:27 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:28.162749 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:28.163364 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:28.169240 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:28.169686 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:28.170445 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:28.170900 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:28.303414 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:28.311217 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-22f2e651-b465-4468-8da6-945fff63d346 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.152098 Jul 27 15:32:28.311779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 596/1166] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:28 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:28.846419 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:28.847054 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:28.853537 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:28.853979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:28.854766 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:28.855206 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:28.985076 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:28.992325 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-a066c541-9b0c-4599-a7ef-72e45c7d5b9b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.149576 Jul 27 15:32:28.992895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 571/1167] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:28 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:29.328322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:29.328923 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:29.334710 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:29.335150 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:29.335899 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:29.336322 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:29.467733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:29.474734 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f0c13999-1548-4e3e-b049-2924ee9b9226 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.150037 Jul 27 15:32:29.475296 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 597/1168] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:29 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:30.008855 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:30.009463 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:30.015290 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:30.015733 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:30.016493 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:30.016920 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:30.151583 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:30.158933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-9da36eff-fa04-4ad9-b502-5f688f991eb8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.153726 Jul 27 15:32:30.159495 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 572/1169] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:30 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:30.491132 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:30.491770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:30.497665 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:30.498113 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:30.498898 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:30.499329 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:30.630646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:30.638380 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-7821ba8b-ce79-41aa-a01e-aaeb4e1af5bd tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.150863 Jul 27 15:32:30.638970 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 598/1170] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:30 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:31.176548 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:31.177195 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:31.183933 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:31.184381 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:31.185154 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:31.185584 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:31.325668 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:31.333310 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8365c849-cf97-4006-bd31-54f793931f60 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.160503 Jul 27 15:32:31.333873 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 573/1171] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:31 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:31.655569 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:31.656196 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:31.662229 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:31.662676 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:31.663435 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:31.663859 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:31.795482 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:31.802643 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-76727a2b-e81b-4d0f-ad0f-cf506d4fb037 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.150727 Jul 27 15:32:31.803206 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 599/1172] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:31 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:32.349896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:32.350554 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:32.356266 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:32.356709 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:32.357467 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:32.357890 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:32.489332 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:32.496571 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-73aefc55-c4c2-45d7-a4b9-233fb5eed402 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.150333 Jul 27 15:32:32.497639 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 574/1173] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:32 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:32.818569 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:32.819179 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:32.825147 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:32.825589 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:32.826352 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:32.826810 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:32.962588 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:32.969708 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-44294d20-08fb-454a-8a84-cb25d002c1a3 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.154871 Jul 27 15:32:32.970266 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 600/1174] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:32 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:33.513465 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:33.514077 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:33.519954 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:33.520402 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:33.521160 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:33.521595 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:33.652487 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:33.660535 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7d987d10-2f1c-4fbc-9dc5-a7d096c512e0 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.151267 Jul 27 15:32:33.661099 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 575/1175] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:33 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:33.986828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:33.987504 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:33.993640 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:33.994079 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:33.994883 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:33.995343 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:34.133842 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:34.141711 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-461b3c57-62ed-41d0-8032-a2b94dbf907a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.158561 Jul 27 15:32:34.142362 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 601/1176] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:33 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:34.257561 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-a9375682-29f5-4cdf-b4da-f7d014387b1c req-54989ed2-8383-4bbb-a887-320456e37ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0", "name": "network-vif-plugged", "status": "completed", "tag": "b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:34.259148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:32:34.259148 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:32:34.266036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-a9375682-29f5-4cdf-b4da-f7d014387b1c req-54989ed2-8383-4bbb-a887-320456e37ba3 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:34.266496 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-a9375682-29f5-4cdf-b4da-f7d014387b1c req-54989ed2-8383-4bbb-a887-320456e37ba3 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:34.277266 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-a9375682-29f5-4cdf-b4da-f7d014387b1c req-54989ed2-8383-4bbb-a887-320456e37ba3 service nova] Creating event network-vif-plugged:b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322 for instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 on hv-cinder-80043 Jul 27 15:32:34.282603 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-a9375682-29f5-4cdf-b4da-f7d014387b1c req-54989ed2-8383-4bbb-a887-320456e37ba3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028599 Jul 27 15:32:34.283191 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 576/1177] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:32:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:34.676574 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:34.677310 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:34.683044 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:34.683492 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:34.684753 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:34.685186 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:34.819391 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:34.827143 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-f3165b8a-9f5e-4164-84ab-302d3ce80071 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.154339 Jul 27 15:32:34.827705 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 602/1178] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:34 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:35.159154 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:35.159776 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:35.165869 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:35.166323 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:35.167107 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:35.167543 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:35.300749 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:35.307969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4aa61fdf-a089-4ef6-ad26-14af61c60ad2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1576 microversion: 2.1 time: 0.153202 Jul 27 15:32:35.308530 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 577/1179] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:35 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:35.847741 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:35.848289 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:35.854222 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:35.854740 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:35.855465 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:35.855899 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:35.992027 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:36.000153 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-4cb401dc-8ef9-48f2-a598-11540d86a6c9 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.156151 Jul 27 15:32:36.000725 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 603/1180] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:35 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:36.297529 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-4bc78ea0-ade5-4620-b854-47de8c7dfc51 req-3c9072e6-f947-4819-90c7-6fa757fa683c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d872d5-665e-46be-9f34-856441ac0b06", "name": "network-vif-plugged", "status": "completed", "tag": "9c2d5624-5a13-4e47-a504-f32fcb79febc"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:36.299059 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:32:36.299059 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:32:36.305778 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-4bc78ea0-ade5-4620-b854-47de8c7dfc51 req-3c9072e6-f947-4819-90c7-6fa757fa683c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:36.306222 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-4bc78ea0-ade5-4620-b854-47de8c7dfc51 req-3c9072e6-f947-4819-90c7-6fa757fa683c service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:36.316728 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-4bc78ea0-ade5-4620-b854-47de8c7dfc51 req-3c9072e6-f947-4819-90c7-6fa757fa683c service nova] Creating event network-vif-plugged:9c2d5624-5a13-4e47-a504-f32fcb79febc for instance 58d872d5-665e-46be-9f34-856441ac0b06 on hv-cinder-80043 Jul 27 15:32:36.321611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-4bc78ea0-ade5-4620-b854-47de8c7dfc51 req-3c9072e6-f947-4819-90c7-6fa757fa683c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028251 Jul 27 15:32:36.322205 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 578/1181] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:32:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:32:36.324660 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:36.325268 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:36.331013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:36.331451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:36.332199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:36.332618 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:36.470826 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:36.477981 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-06f067cb-cf48-4a8a-98b0-e03031ceaf96 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1563 microversion: 2.1 time: 0.157131 Jul 27 15:32:36.478555 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 604/1182] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:36 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:32:37.017010 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:37.017742 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:37.023677 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:37.024124 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:37.024884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:37.025318 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:37.160187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:37.167328 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-c6666d4d-4741-4ca7-86a6-6f31b8f86edf tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1266 microversion: 2.1 time: 0.154389 Jul 27 15:32:37.167895 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 579/1183] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:37 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:38.184989 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:38.185528 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:38.191329 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:38.191770 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:38.192533 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:38.192956 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:38.327235 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:38.334315 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9eade6fb-5ee7-4df5-8783-147196e0186c tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1453 microversion: 2.1 time: 0.153757 Jul 27 15:32:38.334910 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 605/1184] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:38 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:38.350145 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:32:38.350808 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:32:38.357059 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:38.357515 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:38.358286 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:38.358751 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:38.491302 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:32:38.499050 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1850e5b6-aaca-490f-888a-d711d633bb8b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1453 microversion: 2.1 time: 0.152433 Jul 27 15:32:38.499629 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 580/1185] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:32:38 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:32:40.093531 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-35e42bdf-3eaf-46b7-80ad-a4d3955d0356 req-8407d6b6-28bd-4623-8881-69c3ec5843d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d872d5-665e-46be-9f34-856441ac0b06", "tag": "9c2d5624-5a13-4e47-a504-f32fcb79febc"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:32:40.095086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:32:40.095086 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:32:40.101922 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-35e42bdf-3eaf-46b7-80ad-a4d3955d0356 req-8407d6b6-28bd-4623-8881-69c3ec5843d2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:32:40.102356 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-35e42bdf-3eaf-46b7-80ad-a4d3955d0356 req-8407d6b6-28bd-4623-8881-69c3ec5843d2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:32:40.114151 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-35e42bdf-3eaf-46b7-80ad-a4d3955d0356 req-8407d6b6-28bd-4623-8881-69c3ec5843d2 service nova] Creating event network-changed:9c2d5624-5a13-4e47-a504-f32fcb79febc for instance 58d872d5-665e-46be-9f34-856441ac0b06 on hv-cinder-80043 Jul 27 15:32:40.119132 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-35e42bdf-3eaf-46b7-80ad-a4d3955d0356 req-8407d6b6-28bd-4623-8881-69c3ec5843d2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029677 Jul 27 15:32:40.119717 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 606/1186] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:32:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:33:55.919975 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa5fe9fb-01d5-44db-834e-17c7adfe68ea] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 15:33:55.925347 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b237722d-a0ec-493c-925a-14635ce6fa2d] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 15:33:55.928201 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:55.928534 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:33:55.934000 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-72035083-a607-4b33-9dd7-a895cfcf6cf8 req-a611facb-35a5-416b-8dab-639202c3aab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0", "tag": "b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:55.934996 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:55.935509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:33:55.935509 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:33:55.935712 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:55.936442 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:55.936950 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:55.942683 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-72035083-a607-4b33-9dd7-a895cfcf6cf8 req-a611facb-35a5-416b-8dab-639202c3aab2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:55.943141 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-72035083-a607-4b33-9dd7-a895cfcf6cf8 req-a611facb-35a5-416b-8dab-639202c3aab2 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:55.955469 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-72035083-a607-4b33-9dd7-a895cfcf6cf8 req-a611facb-35a5-416b-8dab-639202c3aab2 service nova] Creating event network-changed:b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322 for instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 on hv-cinder-80043 Jul 27 15:33:55.960872 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-72035083-a607-4b33-9dd7-a895cfcf6cf8 req-a611facb-35a5-416b-8dab-639202c3aab2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037075 Jul 27 15:33:55.961772 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 607/1187] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:33:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:33:55.964884 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:33:56.052848 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-847c6289-4093-4803-ba1a-0e3f0c90ce87 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "DELETE /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 204 len: 0 microversion: 2.1 time: 0.134319 Jul 27 15:33:56.056545 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 581/1188] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:33:55 2021] DELETE /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:33:56.062448 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:56.063185 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:33:56.069809 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:56.070258 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:56.071257 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:56.071943 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:56.338483 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:56.346746 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0bfe8bf0-4d73-4af9-9062-379a814f3484 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1569 microversion: 2.1 time: 0.288607 Jul 27 15:33:56.347396 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 608/1189] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:33:56 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:57.364500 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:57.365237 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:33:57.382386 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:57.382863 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:57.383620 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:57.384045 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:57.398615 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa5fe9fb-01d5-44db-834e-17c7adfe68ea] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 45406. Jul 27 15:33:57.526168 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:57.534939 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-07c67a8e-0285-4859-a902-e8138c9721db tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1450 microversion: 2.1 time: 0.174484 Jul 27 15:33:57.535544 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 582/1190] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:33:57 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:58.553427 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:58.554664 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:33:58.572733 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:58.573463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:58.574243 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:58.574709 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:58.604098 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO oslo.messaging._drivers.impl_rabbit [-] [b237722d-a0ec-493c-925a-14635ce6fa2d] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 45412. Jul 27 15:33:58.649378 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-f0b125b6-3673-473a-be11-3e28eb6ed0ee req-3102a373-3d03-4cf2-a52b-a742b385588b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0", "name": "network-vif-deleted", "tag": "b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:33:58.651562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:33:58.651562 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:33:58.660987 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f0b125b6-3673-473a-be11-3e28eb6ed0ee req-3102a373-3d03-4cf2-a52b-a742b385588b service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:58.661920 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-f0b125b6-3673-473a-be11-3e28eb6ed0ee req-3102a373-3d03-4cf2-a52b-a742b385588b service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:58.669201 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:58.678312 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-9eada785-6630-4edd-8694-240fb6f9112b tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1382 microversion: 2.1 time: 0.127862 Jul 27 15:33:58.679035 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 609/1191] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:33:58 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1382 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:33:58.680226 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-f0b125b6-3673-473a-be11-3e28eb6ed0ee req-3102a373-3d03-4cf2-a52b-a742b385588b service nova] Creating event network-vif-deleted:b49a7e3b-9f1c-428b-9a6c-5b5cd25d8322 for instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 on hv-cinder-80043 Jul 27 15:33:58.686115 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-f0b125b6-3673-473a-be11-3e28eb6ed0ee req-3102a373-3d03-4cf2-a52b-a742b385588b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040025 Jul 27 15:33:58.686642 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 583/1192] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:33:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:33:59.695102 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:33:59.695712 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:33:59.701434 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:59.701886 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:59.702707 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:59.703147 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:59.732745 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:33:59.733193 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:33:59.733639 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.objects.instance [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lazy-loading 'fault' on Instance uuid 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 {{(pid=107332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:33:59.775870 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99293d568f82450f8becc49e2a3a163c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d408d4ffc5942fd9b0b500355b1e57a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:33:59.783176 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-1518ead2-7fb2-41f6-8943-1a00814dc8a2 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 200 len: 1178 microversion: 2.1 time: 0.091743 Jul 27 15:33:59.783754 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 610/1193] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:33:59 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 1178 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:00.800413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:00.801034 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [instance: 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:00.807065 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:00.807512 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:00.808276 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:00.808811 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:00.821380 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] HTTP exception thrown: Instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 could not be found. Jul 27 15:34:00.821955 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Returning 404 to user: Instance 116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:34:00.822809 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-7abb60f5-6fe9-451b-a34b-2cdbd9a93f30 tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0" status: 404 len: 111 microversion: 2.1 time: 0.026492 Jul 27 15:34:00.823318 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 584/1194] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:00 2021] GET /compute/v2.1/servers/116cfaa1-4b7f-4c06-bab8-0e041ee6ffa0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:00.980270 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-52e0e4da-dd7c-4b36-ba87-ab21f553911a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] Calling method '.version_select at 0x7f340056a550>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:00.983498 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52e0e4da-dd7c-4b36-ba87-ab21f553911a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [f158f72b-c083-4321-9a7f-8dab20274844] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 15:34:02.000103 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO oslo.messaging._drivers.impl_rabbit [None req-52e0e4da-dd7c-4b36-ba87-ab21f553911a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] [f158f72b-c083-4321-9a7f-8dab20274844] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 45430. Jul 27 15:34:02.017326 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-52e0e4da-dd7c-4b36-ba87-ab21f553911a tempest-TestShelveInstance-2084344496 tempest-TestShelveInstance-2084344496-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-998460484" status: 202 len: 0 microversion: 2.1 time: 1.040677 Jul 27 15:34:02.017896 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 611/1195] 10.222.0.37 () {58 vars in 1251 bytes} [Tue Jul 27 15:34:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-998460484 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:34:19.804177 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:19.804687 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:19.817018 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:19.817336 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:19.818132 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:19.818715 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:19.843322 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:34:19.929666 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-234954b6-f1ef-4d77-8280-a66c30c671c8 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "DELETE /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 204 len: 0 microversion: 2.1 time: 0.128664 Jul 27 15:34:19.930317 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 585/1196] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:34:19 2021] DELETE /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:34:19.939948 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:19.940740 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:19.946913 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:19.947502 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:19.948555 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:19.948936 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:20.007790 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-78895e85-f656-4345-be1f-c7a753552797 req-d0d0c47a-73ef-4b5e-afe4-db7f242e5388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d872d5-665e-46be-9f34-856441ac0b06", "tag": "9c2d5624-5a13-4e47-a504-f32fcb79febc"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:20.009407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:34:20.009407 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:34:20.017166 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-78895e85-f656-4345-be1f-c7a753552797 req-d0d0c47a-73ef-4b5e-afe4-db7f242e5388 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:20.017895 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-78895e85-f656-4345-be1f-c7a753552797 req-d0d0c47a-73ef-4b5e-afe4-db7f242e5388 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:20.029013 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-78895e85-f656-4345-be1f-c7a753552797 req-d0d0c47a-73ef-4b5e-afe4-db7f242e5388 service nova] Creating event network-changed:9c2d5624-5a13-4e47-a504-f32fcb79febc for instance 58d872d5-665e-46be-9f34-856441ac0b06 on hv-cinder-80043 Jul 27 15:34:20.034946 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-78895e85-f656-4345-be1f-c7a753552797 req-d0d0c47a-73ef-4b5e-afe4-db7f242e5388 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226497 Jul 27 15:34:20.035828 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 612/1197] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:34:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:20.092436 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:20.101460 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-e93f3d0f-e741-41c9-8968-481a75cf4c78 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1577 microversion: 2.1 time: 0.166353 Jul 27 15:34:20.102039 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 586/1198] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:19 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:21.120346 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:21.120968 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:21.127023 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:21.127466 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:21.128218 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:21.128646 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:21.263851 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:21.271544 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-2864854e-a7a7-4915-83a3-46fe4d0bf2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1459 microversion: 2.1 time: 0.155232 Jul 27 15:34:21.272104 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 613/1199] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:21 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:22.288880 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:22.289488 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:22.295174 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:22.295621 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:22.297009 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:22.297445 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:22.438261 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:22.445699 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-bfdf8f07-ddd7-482f-929d-cac1e7a82f37 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1459 microversion: 2.1 time: 0.160481 Jul 27 15:34:22.446269 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 587/1200] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:22 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1459 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:22.615405 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-4e39b35c-ee7d-4ecc-8ef0-8079a5602813 req-aa6ed148-4030-4d22-b7bc-c60148885d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d872d5-665e-46be-9f34-856441ac0b06", "name": "network-vif-deleted", "tag": "9c2d5624-5a13-4e47-a504-f32fcb79febc"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:22.616893 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:34:22.616893 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:34:22.623658 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-4e39b35c-ee7d-4ecc-8ef0-8079a5602813 req-aa6ed148-4030-4d22-b7bc-c60148885d50 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:22.624104 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-4e39b35c-ee7d-4ecc-8ef0-8079a5602813 req-aa6ed148-4030-4d22-b7bc-c60148885d50 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:22.634938 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-4e39b35c-ee7d-4ecc-8ef0-8079a5602813 req-aa6ed148-4030-4d22-b7bc-c60148885d50 service nova] Creating event network-vif-deleted:9c2d5624-5a13-4e47-a504-f32fcb79febc for instance 58d872d5-665e-46be-9f34-856441ac0b06 on hv-cinder-80043 Jul 27 15:34:22.639729 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-4e39b35c-ee7d-4ecc-8ef0-8079a5602813 req-aa6ed148-4030-4d22-b7bc-c60148885d50 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027951 Jul 27 15:34:22.640868 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 614/1201] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:34:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:23.462679 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:23.463301 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:23.470747 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:23.471193 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:23.471979 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:23.472413 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:23.504830 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:23.505277 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:23.505727 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.objects.instance [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lazy-loading 'fault' on Instance uuid 58d872d5-665e-46be-9f34-856441ac0b06 {{(pid=107333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 27 15:34:23.548889 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:23.555908 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-2fcd1cb6-008a-4e97-862a-97185b672411 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 200 len: 1185 microversion: 2.1 time: 0.097431 Jul 27 15:34:23.556665 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 588/1202] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:23 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 1185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:24.573198 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:24.573885 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 58d872d5-665e-46be-9f34-856441ac0b06] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:24.579895 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:24.580338 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:24.581087 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:24.581513 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:24.594609 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] HTTP exception thrown: Instance 58d872d5-665e-46be-9f34-856441ac0b06 could not be found. Jul 27 15:34:24.595173 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Returning 404 to user: Instance 58d872d5-665e-46be-9f34-856441ac0b06 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:34:24.595963 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-3436b90b-19a5-49f1-90df-c548b861dbe6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06" status: 404 len: 111 microversion: 2.1 time: 0.026779 Jul 27 15:34:24.596463 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 615/1203] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:24 2021] GET /compute/v2.1/servers/58d872d5-665e-46be-9f34-856441ac0b06 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:27.638713 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:27.639233 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:27.641148 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [req-87eeb616-0554-43b7-a5d0-d8e4cbb8d177 req-11d0eb09-7e21-4ae3-ac98-25732ee0fa82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650b1a2d-a516-43c0-97e2-a5a1becc6e51", "tag": "892469b6-0ff1-42ac-971b-744a28fd4453"}]} {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:27.642742 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:34:27.642742 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: warnings.warn(msg) Jul 27 15:34:27.645620 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:27.646293 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:27.646886 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:27.647320 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:27.649727 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-87eeb616-0554-43b7-a5d0-d8e4cbb8d177 req-11d0eb09-7e21-4ae3-ac98-25732ee0fa82 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:27.650403 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [req-87eeb616-0554-43b7-a5d0-d8e4cbb8d177 req-11d0eb09-7e21-4ae3-ac98-25732ee0fa82 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:27.663182 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.compute.server_external_events [req-87eeb616-0554-43b7-a5d0-d8e4cbb8d177 req-11d0eb09-7e21-4ae3-ac98-25732ee0fa82 service nova] Creating event network-changed:892469b6-0ff1-42ac-971b-744a28fd4453 for instance 650b1a2d-a516-43c0-97e2-a5a1becc6e51 on hv-cinder-80043 Jul 27 15:34:27.668055 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [req-87eeb616-0554-43b7-a5d0-d8e4cbb8d177 req-11d0eb09-7e21-4ae3-ac98-25732ee0fa82 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030625 Jul 27 15:34:27.668956 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 616/1204] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:34:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 15:34:27.673969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Going to try to terminate instance {{(pid=107333) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 27 15:34:27.749522 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-4ffe1134-5afa-45b8-8cbb-6ae95d5ad2ca tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "DELETE /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 204 len: 0 microversion: 2.1 time: 0.114419 Jul 27 15:34:27.753100 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 589/1205] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:34:27 2021] DELETE /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 15:34:27.759451 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:27.760192 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:27.767308 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:27.767809 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:27.768571 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:27.768999 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:27.911756 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:27.920682 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0cd417b2-efd5-4851-bbac-ab7c7be176b6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1579 microversion: 2.1 time: 0.165996 Jul 27 15:34:27.925869 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 617/1206] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:27 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 15:34:28.939561 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:28.940269 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:28.946102 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:28.946592 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:28.947359 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:28.947798 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:29.079604 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.policy [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:29.086705 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-8e40ecaf-8a1e-419f-bc67-8b9629c97e3a tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1460 microversion: 2.1 time: 0.151683 Jul 27 15:34:29.087268 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 590/1207] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:28 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1460 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:30.104121 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:30.104796 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:30.112248 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:30.112699 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:30.113470 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:30.113901 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:30.122349 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [req-1c923975-5892-48bd-9d20-6c52653da130 req-55ac481a-8712-4a82-a1ee-37065a7ef802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650b1a2d-a516-43c0-97e2-a5a1becc6e51", "name": "network-vif-deleted", "tag": "892469b6-0ff1-42ac-971b-744a28fd4453"}]} {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 15:34:30.123899 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:34:30.123899 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: warnings.warn(msg) Jul 27 15:34:30.130799 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-1c923975-5892-48bd-9d20-6c52653da130 req-55ac481a-8712-4a82-a1ee-37065a7ef802 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:30.131232 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [req-1c923975-5892-48bd-9d20-6c52653da130 req-55ac481a-8712-4a82-a1ee-37065a7ef802 service nova] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:30.143311 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.compute.server_external_events [req-1c923975-5892-48bd-9d20-6c52653da130 req-55ac481a-8712-4a82-a1ee-37065a7ef802 service nova] Creating event network-vif-deleted:892469b6-0ff1-42ac-971b-744a28fd4453 for instance 650b1a2d-a516-43c0-97e2-a5a1becc6e51 on hv-cinder-80043 Jul 27 15:34:30.148440 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [req-1c923975-5892-48bd-9d20-6c52653da130 req-55ac481a-8712-4a82-a1ee-37065a7ef802 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 Jul 27 15:34:30.149354 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 591/1208] 10.222.0.37 () {64 vars in 1318 bytes} [Tue Jul 27 15:34:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 15:34:30.183185 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.policy [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc4e200664d4b850d1f84a946e576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a65d475c9846dfabea23794dd2e636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107332) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 15:34:30.190773 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-50576a98-476e-40ed-b34a-759f78a5b2ff tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 200 len: 1393 microversion: 2.1 time: 0.091196 Jul 27 15:34:30.191333 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 618/1209] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:30 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 1393 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 15:34:31.207743 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:31.208435 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 650b1a2d-a516-43c0-97e2-a5a1becc6e51] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:31.214384 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:31.214857 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:31.215611 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:31.216036 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:31.229896 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] HTTP exception thrown: Instance 650b1a2d-a516-43c0-97e2-a5a1becc6e51 could not be found. Jul 27 15:34:31.230484 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Returning 404 to user: Instance 650b1a2d-a516-43c0-97e2-a5a1becc6e51 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:34:31.231276 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-1da23c33-7133-4009-8be0-6e2eef9512eb tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51" status: 404 len: 111 microversion: 2.1 time: 0.027579 Jul 27 15:34:31.231777 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 592/1210] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:31 2021] GET /compute/v2.1/servers/650b1a2d-a516-43c0-97e2-a5a1becc6e51 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:31.666693 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:31.667270 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.compute.api [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107332) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:31.673323 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:31.673764 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:31.674557 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:31.674988 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG oslo_concurrency.lockutils [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:31.688199 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.wsgi [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] HTTP exception thrown: Instance 87ef0c4e-a573-460d-aa95-239b4e897f74 could not be found. Jul 27 15:34:31.688779 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Returning 404 to user: Instance 87ef0c4e-a573-460d-aa95-239b4e897f74 could not be found. {{(pid=107332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:34:31.689951 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-0932ed27-9d10-4004-b797-47216d48974b tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "DELETE /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 404 len: 111 microversion: 2.1 time: 0.026593 Jul 27 15:34:31.690096 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 619/1211] 10.222.0.37 () {58 vars in 1239 bytes} [Tue Jul 27 15:34:31 2021] DELETE /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 15:34:31.698187 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '>' {{(pid=107333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:31.699885 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.compute.api [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] [instance: 87ef0c4e-a573-460d-aa95-239b4e897f74] Fetching instance by UUID {{(pid=107333) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 27 15:34:31.706648 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:31.707103 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:31.707969 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 27 15:34:31.708370 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG oslo_concurrency.lockutils [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Lock "4ff5b841-e3d6-4f57-b836-5edd3f142ad2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 27 15:34:31.722991 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.wsgi [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] HTTP exception thrown: Instance 87ef0c4e-a573-460d-aa95-239b4e897f74 could not be found. Jul 27 15:34:31.723578 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: DEBUG nova.api.openstack.wsgi [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Returning 404 to user: Instance 87ef0c4e-a573-460d-aa95-239b4e897f74 could not be found. {{(pid=107333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 27 15:34:31.724435 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO nova.api.openstack.requestlog [None req-cf185f02-b368-4e6a-b45c-702df27c0b28 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74" status: 404 len: 111 microversion: 2.1 time: 0.030013 Jul 27 15:34:31.725816 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: [pid: 107333|app: 0|req: 593/1212] 10.222.0.37 () {58 vars in 1236 bytes} [Tue Jul 27 15:34:31 2021] GET /compute/v2.1/servers/87ef0c4e-a573-460d-aa95-239b4e897f74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 15:34:33.005496 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: DEBUG nova.api.openstack.wsgi [None req-5a575862-2f55-4887-ab86-08c63ede93d6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] Calling method '.version_select at 0x7f340056af70>' {{(pid=107332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 15:34:33.023603 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO nova.api.openstack.requestlog [None req-5a575862-2f55-4887-ab86-08c63ede93d6 tempest-TestVolumeBootPattern-489673708 tempest-TestVolumeBootPattern-489673708-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2028062658" status: 202 len: 0 microversion: 2.1 time: 0.022120 Jul 27 15:34:33.024180 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: [pid: 107332|app: 0|req: 620/1213] 10.222.0.37 () {58 vars in 1263 bytes} [Tue Jul 27 15:34:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2028062658 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 15:34:56.292022 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:34:56.292649 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: Tue Jul 27 15:34:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:34:58.964710 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:34:58.965136 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: Tue Jul 27 15:34:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:35:07.261273 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:35:07.261908 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: Tue Jul 27 15:35:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:37:00.092388 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:37:00.092924 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: Tue Jul 27 15:37:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:37:02.492590 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:37:02.493175 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: Tue Jul 27 15:37:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:38:16.309931 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:38:16.310500 dv-cinder-800431-2-iscsi devstack@n-api.service[107332]: Tue Jul 27 15:38:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:38:18.982288 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:38:18.982761 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: Tue Jul 27 15:38:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 15:38:27.279074 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 15:38:27.279691 dv-cinder-800431-2-iscsi devstack@n-api.service[107333]: Tue Jul 27 15:38:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!